Oct 23 22:54:57 user nova-compute[74482]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74482) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 22:54:57 user nova-compute[74482]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74482) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 22:54:57 user nova-compute[74482]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74482) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 22:54:57 user nova-compute[74482]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 23 22:54:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:54:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:54:57 user nova-compute[74482]: INFO nova.virt.driver [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 23 22:54:57 user nova-compute[74482]: INFO nova.compute.provider_config [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] Acquiring lock "singleton_lock" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] Acquired lock "singleton_lock" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] Releasing lock "singleton_lock" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] Full set of CONF: {{(pid=74482) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ******************************************************************************** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] Configuration options gathered from: {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ================================================================================ {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] allow_resize_to_same_host      = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] arq_binding_timeout            = 300 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] backdoor_port                  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] backdoor_socket                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] block_device_allocate_retries  = 300 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] block_device_allocate_retries_interval = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cert                           = self.pem {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute_monitors               = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] config_dir                     = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] config_drive_format            = iso9660 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] config_source                  = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] console_host                   = user {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] control_exchange               = nova {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cpu_allocation_ratio           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] daemon                         = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] debug                          = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] default_access_ip_network_name = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] default_availability_zone      = nova {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] default_ephemeral_format       = ext4 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] default_green_pool_size        = 1000 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] default_schedule_zone          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] disk_allocation_ratio          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] enable_new_services            = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] enabled_apis                   = ['osapi_compute'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] enabled_ssl_apis               = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] flat_injected                  = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] force_config_drive             = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] force_raw_images               = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] graceful_shutdown_timeout      = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] heal_instance_info_cache_interval = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] host                           = user {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] instance_build_timeout         = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] instance_delete_interval       = 300 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] instance_format                = [instance: %(uuid)s]  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] instance_name_template         = instance-%08x {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] instance_usage_audit           = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] instance_usage_audit_period    = month {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] internal_service_availability_zone = internal {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] key                            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] live_migration_retry_count     = 30 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] log_config_append              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] log_dir                        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] log_file                       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] log_options                    = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] log_rotate_interval            = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] log_rotate_interval_type       = days {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] log_rotation_type              = none {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] long_rpc_timeout               = 1800 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] max_concurrent_builds          = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] max_concurrent_live_migrations = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] max_concurrent_snapshots       = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] max_local_block_devices        = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] max_logfile_count              = 30 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] max_logfile_size_mb            = 200 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] maximum_instance_delete_attempts = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] metadata_listen                = 0.0.0.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] metadata_listen_port           = 8775 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] metadata_workers               = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] migrate_max_retries            = -1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] mkisofs_cmd                    = genisoimage {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] my_ip                          = 10.0.0.210 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] network_allocate_retries       = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] osapi_compute_listen_port      = 8774 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] osapi_compute_unique_server_name_scope =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] osapi_compute_workers          = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] password_length                = 12 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] periodic_enable                = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] periodic_fuzzy_delay           = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] pointer_model                  = ps2mouse {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] preallocate_images             = none {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] publish_errors                 = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] pybasedir                      = /opt/stack/nova {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ram_allocation_ratio           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] rate_limit_burst               = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] rate_limit_except_level        = CRITICAL {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] rate_limit_interval            = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] reboot_timeout                 = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] reclaim_instance_interval      = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] record                         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] reimage_timeout_per_gb         = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] report_interval                = 120 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] rescue_timeout                 = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] reserved_host_cpus             = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] reserved_host_disk_mb          = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] reserved_host_memory_mb        = 512 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] reserved_huge_pages            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] resize_confirm_window          = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] resize_fs_using_block_device   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] resume_guests_state_on_host_boot = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] rpc_response_timeout           = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] run_external_periodic_tasks    = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] running_deleted_instance_action = reap {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] running_deleted_instance_poll_interval = 1800 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] running_deleted_instance_timeout = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler_instance_sync_interval = 120 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_down_time              = 720 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] servicegroup_driver            = db {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] shelved_offload_time           = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] shelved_poll_interval          = 3600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] shutdown_timeout               = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] source_is_ipv6                 = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ssl_only                       = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] state_path                     = /opt/stack/data/nova {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] sync_power_state_interval      = 600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] sync_power_state_pool_size     = 1000 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] syslog_log_facility            = LOG_USER {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] tempdir                        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] timeout_nbd                    = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] transport_url                  = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] update_resources_interval      = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] use_cow_images                 = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] use_eventlog                   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] use_journal                    = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] use_json                       = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] use_rootwrap_daemon            = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] use_stderr                     = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] use_syslog                     = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vcpu_pin_set                   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plugging_is_fatal          = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plugging_timeout           = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] virt_mkfs                      = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] volume_usage_poll_interval     = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] watch_log_file                 = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] web                            = /usr/share/spice-html5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_concurrency.disable_process_locking = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.auth_strategy              = keystone {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.compute_link_prefix        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.dhcp_domain                = novalocal {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.enable_instance_password   = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.glance_link_prefix         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.instance_list_per_project_cells = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.list_records_by_skipping_down_cells = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.local_metadata_per_cell    = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.max_limit                  = 1000 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.metadata_cache_expiration  = 15 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.neutron_default_tenant_id  = default {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.use_forwarded_for          = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.use_neutron_default_nets   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.vendordata_dynamic_targets = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.vendordata_jsonfile_path   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.backend                  = dogpile.cache.memcached {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.backend_argument         = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.config_prefix            = cache.oslo {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.dead_timeout             = 60.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.debug_cache_backend      = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.enable_retry_client      = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.enable_socket_keepalive  = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.enabled                  = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.expiration_time          = 600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.hashclient_retry_attempts = 2 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_dead_retry      = 300 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_password        =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_pool_maxsize    = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_sasl_enabled    = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.memcache_username        =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.proxies                  = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.retry_attempts           = 2 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.retry_delay              = 0.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.socket_keepalive_count   = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.socket_keepalive_idle    = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.socket_keepalive_interval = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.tls_allowed_ciphers      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.tls_cafile               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.tls_certfile             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.tls_enabled              = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cache.tls_keyfile              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.auth_section            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.auth_type               = password {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.cafile                  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.certfile                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.collect_timing          = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.cross_az_attach         = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.debug                   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.endpoint_template       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.http_retries            = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.insecure                = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.keyfile                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.os_region_name          = RegionOne {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.split_loggers           = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cinder.timeout                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.cpu_dedicated_set      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.cpu_shared_set         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.image_type_exclude_list = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.max_concurrent_disk_ops = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.max_disk_devices_to_attach = -1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.resource_provider_association_refresh = 300 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.shutdown_retry_interval = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] conductor.workers              = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] console.allowed_origins        = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] console.ssl_ciphers            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] console.ssl_minimum_version    = default {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] consoleauth.token_ttl          = 600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.cafile                  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.certfile                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.collect_timing          = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.connect_retries         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.connect_retry_delay     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.endpoint_override       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.insecure                = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.keyfile                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.max_version             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.min_version             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.region_name             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.service_name            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.service_type            = accelerator {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.split_loggers           = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.status_code_retries     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.status_code_retry_delay = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.timeout                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] cyborg.version                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.backend               = sqlalchemy {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.connection            = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.connection_debug      = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.connection_parameters =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.connection_recycle_time = 3600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.connection_trace      = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.db_inc_retry_interval = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.db_max_retries        = 20 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.db_max_retry_interval = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.db_retry_interval     = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.max_overflow          = 50 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.max_pool_size         = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.max_retries           = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.mysql_wsrep_sync_wait = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.pool_timeout          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.retry_interval        = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.slave_connection      = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] database.sqlite_synchronous    = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.backend           = sqlalchemy {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.connection        = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.connection_debug  = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.connection_parameters =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.connection_recycle_time = 3600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.connection_trace  = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.db_inc_retry_interval = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.db_max_retries    = 20 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.db_max_retry_interval = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.db_retry_interval = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.max_overflow      = 50 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.max_pool_size     = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.max_retries       = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.pool_timeout      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.retry_interval    = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.slave_connection  = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] api_database.sqlite_synchronous = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] devices.enabled_mdev_types     = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ephemeral_storage_encryption.enabled = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.api_servers             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.cafile                  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.certfile                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.collect_timing          = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.connect_retries         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.connect_retry_delay     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.debug                   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.default_trusted_certificate_ids = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.enable_certificate_validation = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.enable_rbd_download     = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.endpoint_override       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.insecure                = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.keyfile                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.max_version             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.min_version             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.num_retries             = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.rbd_ceph_conf           =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.rbd_connect_timeout     = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.rbd_pool                =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.rbd_user                =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.region_name             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.service_name            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.service_type            = image {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.split_loggers           = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.status_code_retries     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.status_code_retry_delay = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.timeout                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.verify_glance_signatures = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] glance.version                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] guestfs.debug                  = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.config_drive_cdrom      = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.config_drive_inject_password = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.enable_instance_metrics_collection = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.enable_remotefx         = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.instances_path_share    =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.iscsi_initiator_list    = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.limit_cpu_features      = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.power_state_check_timeframe = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.use_multipath_io        = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.volume_attach_retry_count = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.vswitch_name            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] mks.enabled                    = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] image_cache.manager_interval   = 2400 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] image_cache.precache_concurrency = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] image_cache.remove_unused_base_images = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] image_cache.subdirectory_name  = _base {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.api_max_retries         = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.api_retry_interval      = 2 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.auth_section            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.auth_type               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.cafile                  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.certfile                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.collect_timing          = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.conductor_group         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.connect_retries         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.connect_retry_delay     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.endpoint_override       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.insecure                = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.keyfile                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.max_version             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.min_version             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.peer_list               = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.region_name             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.serial_console_state_timeout = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.service_name            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.service_type            = baremetal {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.split_loggers           = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.status_code_retries     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.status_code_retry_delay = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.timeout                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ironic.version                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] key_manager.fixed_key          = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.barbican_api_version  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.barbican_endpoint     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.barbican_endpoint_type = public {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.barbican_region_name  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.cafile                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.certfile              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.collect_timing        = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.insecure              = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.keyfile               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.number_of_retries     = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.retry_delay           = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.send_service_user_token = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.split_loggers         = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.timeout               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.verify_ssl            = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican.verify_ssl_path       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican_service_user.auth_section = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican_service_user.auth_type = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican_service_user.cafile   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican_service_user.certfile = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican_service_user.collect_timing = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican_service_user.insecure = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican_service_user.keyfile  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican_service_user.split_loggers = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] barbican_service_user.timeout  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.approle_role_id          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.approle_secret_id        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.cafile                   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.certfile                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.collect_timing           = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.insecure                 = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.keyfile                  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.kv_mountpoint            = secret {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.kv_path                  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.kv_version               = 2 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.namespace                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.root_token_id            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.split_loggers            = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.ssl_ca_crt_file          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.timeout                  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.use_ssl                  = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.auth_section          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.auth_type             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.cafile                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.certfile              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.collect_timing        = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.connect_retries       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.connect_retry_delay   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.endpoint_override     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.insecure              = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.keyfile               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.max_version           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.min_version           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.region_name           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.service_name          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.service_type          = identity {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.split_loggers         = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.status_code_retries   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.status_code_retry_delay = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.timeout               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] keystone.version               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.connection_uri         =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.cpu_mode               = custom {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: WARNING oslo_config.cfg [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.cpu_power_governor_high = performance {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.cpu_power_governor_low = powersave {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.cpu_power_management   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.device_detach_attempts = 8 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.device_detach_timeout  = 20 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.disk_cachemodes        = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.disk_prefix            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.enabled_perf_events    = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.file_backed_memory     = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.gid_maps               = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.hw_disk_discard        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.hw_machine_type        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.images_rbd_glance_store_name =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.images_rbd_pool        = rbd {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.images_type            = default {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.images_volume_group    = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.inject_key             = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.inject_partition       = -2 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.inject_password        = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.iscsi_iface            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.iser_use_multipath     = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_bandwidth = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_downtime = 500 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_inbound_addr = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_permit_post_copy = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_scheme  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_timeout_action = abort {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_tunnelled = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: WARNING oslo_config.cfg [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 23 22:54:58 user nova-compute[74482]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 23 22:54:58 user nova-compute[74482]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 23 22:54:58 user nova-compute[74482]: and ``live_migration_inbound_addr`` respectively.
Oct 23 22:54:58 user nova-compute[74482]: ).  Its value may be silently ignored in the future.
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.live_migration_with_native_tls = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.max_queues             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.nfs_mount_options      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.num_memory_encrypted_guests = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.num_pcie_ports         = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.pmem_namespaces        = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.quobyte_client_cfg     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rbd_secret_uuid        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rbd_user               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.remote_filesystem_transport = ssh {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rescue_image_id        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rescue_kernel_id       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rescue_ramdisk_id      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.rx_queue_size          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.smbfs_mount_options    =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.snapshot_compression   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.snapshot_image_format  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.sparse_logical_volumes = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.swtpm_enabled          = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.swtpm_group            = tss {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.swtpm_user             = tss {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.sysinfo_serial         = unique {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.tb_cache_size          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.tx_queue_size          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.uid_maps               = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.use_virtio_for_bridges = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.virt_type              = kvm {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.volume_clear           = zero {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.volume_clear_size      = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.volume_use_multipath   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.vzstorage_cache_path   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.vzstorage_mount_user   = stack {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.auth_section           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.auth_type              = password {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.cafile                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.certfile               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.collect_timing         = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.connect_retries        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.connect_retry_delay    = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.default_floating_pool  = public {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.endpoint_override      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.extension_sync_interval = 600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.http_retries           = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.insecure               = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.keyfile                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.max_version            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.min_version            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.ovs_bridge             = br-int {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.physnets               = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.region_name            = RegionOne {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.service_metadata_proxy = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.service_name           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.service_type           = network {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.split_loggers          = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.status_code_retries    = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.status_code_retry_delay = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.timeout                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] neutron.version                = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] notifications.bdms_in_notifications = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] notifications.default_level    = INFO {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] notifications.notification_format = unversioned {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] notifications.notify_on_state_change = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] pci.alias                      = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] pci.device_spec                = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] pci.report_in_placement        = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.auth_section         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.auth_type            = password {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.cafile               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.certfile             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.collect_timing       = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.connect_retries      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.connect_retry_delay  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.default_domain_id    = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.default_domain_name  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.domain_id            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.domain_name          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.endpoint_override    = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.insecure             = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.keyfile              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.max_version          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.min_version          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.password             = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.project_domain_id    = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.project_domain_name  = Default {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.project_id           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.project_name         = service {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.region_name          = RegionOne {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.service_name         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.service_type         = placement {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.split_loggers        = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.status_code_retries  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.status_code_retry_delay = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.system_scope         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.timeout              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.trust_id             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.user_domain_id       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.user_domain_name     = Default {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.user_id              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.username             = placement {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] placement.version              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.cores                    = 20 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.count_usage_from_placement = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.injected_file_content_bytes = 10240 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.injected_file_path_length = 255 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.injected_files           = 5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.instances                = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.key_pairs                = 100 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.metadata_items           = 128 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.ram                      = 51200 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.recheck_quota            = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.server_group_members     = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] quota.server_groups            = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] rdp.enabled                    = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.image_metadata_prefilter = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.max_attempts         = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.max_placement_results = 1000 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.query_placement_for_image_type_support = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] scheduler.workers              = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.host_subset_size = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.isolated_hosts = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.isolated_images = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.pci_in_placement = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.track_instance_changes = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] metrics.required               = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] metrics.weight_multiplier      = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] metrics.weight_setting         = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] serial_console.enabled         = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] serial_console.port_range      = 10000:20000 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] serial_console.serialproxy_port = 6083 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.auth_section      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.auth_type         = password {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.cafile            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.certfile          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.collect_timing    = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.insecure          = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.keyfile           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.send_service_user_token = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.split_loggers     = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] service_user.timeout           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.agent_enabled            = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.enabled                  = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.html5proxy_port          = 6082 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.image_compression        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.jpeg_compression         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.playback_compression     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.server_listen            = 127.0.0.1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.streaming_mode           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] spice.zlib_compression         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] upgrade_levels.baseapi         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] upgrade_levels.cert            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] upgrade_levels.compute         = auto {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] upgrade_levels.conductor       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] upgrade_levels.scheduler       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vendordata_dynamic_auth.auth_section = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vendordata_dynamic_auth.auth_type = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vendordata_dynamic_auth.cafile = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vendordata_dynamic_auth.certfile = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vendordata_dynamic_auth.insecure = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vendordata_dynamic_auth.keyfile = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vendordata_dynamic_auth.timeout = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.api_retry_count         = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.ca_file                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.cache_prefix            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.cluster_name            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.connection_pool_size    = 10 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.console_delay_seconds   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.datastore_regex         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.host_ip                 = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.host_password           = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.host_port               = 443 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.host_username           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.insecure                = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.integration_bridge      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.maximum_objects         = 100 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.pbm_default_policy      = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.pbm_enabled             = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.pbm_wsdl_location       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.serial_port_proxy_uri   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.serial_port_service_uri = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.task_poll_interval      = 0.5 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.use_linked_clone        = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.vnc_keymap              = en-us {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.vnc_port                = 5900 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vmware.vnc_port_total          = 10000 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.auth_schemes               = ['none'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.enabled                    = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.novncproxy_port            = 6080 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.server_listen              = 0.0.0.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.vencrypt_ca_certs          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.vencrypt_client_cert       = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vnc.vencrypt_client_key        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.disable_rootwrap   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.enable_numa_live_migration = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.libvirt_disable_apic = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.client_socket_timeout     = 900 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.default_pool_size         = 1000 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.keep_alive                = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.max_header_line           = 16384 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.ssl_ca_file               = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.ssl_cert_file             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.ssl_key_file              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.tcp_keepidle              = 600 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] zvm.ca_file                    = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] zvm.cloud_connector_url        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] zvm.reachable_timeout          = 300 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.enforce_new_defaults = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.enforce_scope      = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.policy_default_rule = default {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.policy_file        = policy.yaml {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.connection_string     = messaging:// {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.enabled               = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.es_doc_type           = notification {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.es_scroll_size        = 10000 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.es_scroll_time        = 2m {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.filter_error_trace    = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.hmac_keys             = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.sentinel_service_name = mymaster {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.socket_timeout        = 0.1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.trace_requests        = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler.trace_sqlalchemy      = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler_jaeger.process_tags   = {} {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler_jaeger.service_name_prefix = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] profiler_otlp.service_name_prefix = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] remote_debug.host              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] remote_debug.port              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.ssl      = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_notifications.retry = -1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_messaging_notifications.transport_url = **** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.auth_section        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.auth_type           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.cafile              = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.certfile            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.collect_timing      = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.connect_retries     = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.connect_retry_delay = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.endpoint_id         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.endpoint_override   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.insecure            = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.keyfile             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.max_version         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.min_version         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.region_name         = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.service_name        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.service_type        = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.split_loggers       = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.status_code_retries = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.status_code_retry_delay = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.timeout             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.valid_interfaces    = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_limit.version             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_reports.file_event_handler = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] oslo_reports.log_dir           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_ovs_privileged.group  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] vif_plug_ovs_privileged.user   = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_linux_bridge.flat_interface = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_ovs.isolate_vif         = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_vif_ovs.per_port_bridge     = False {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] os_brick.lock_path             = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] privsep_osbrick.capabilities   = [21] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] privsep_osbrick.group          = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] privsep_osbrick.helper_command = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] privsep_osbrick.user           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] nova_sys_admin.group           = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] nova_sys_admin.helper_command  = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] nova_sys_admin.user            = None {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG oslo_service.service [None req-449db9aa-f8c8-43d6-b501-3fba65e2a06b None None] ******************************************************************************** {{(pid=74482) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 23 22:54:58 user nova-compute[74482]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 23 22:54:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Connecting to libvirt: qemu:///system {{(pid=74482) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f308ca32500> {{(pid=74482) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 23 22:54:58 user nova-compute[74482]: libvirt:  error : internal error: could not initialize domain event timer
Oct 23 22:54:58 user nova-compute[74482]: WARNING nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 23 22:54:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f308ca32500> {{(pid=74482) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Starting native event thread {{(pid=74482) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Starting green dispatch thread {{(pid=74482) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 23 22:54:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Starting connection event dispatch thread {{(pid=74482) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 23 22:54:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Connection event '1' reason 'None'
Oct 23 22:54:58 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 23 22:54:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.mount [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Initialising _HostMountState generation 0 {{(pid=74482) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 23 22:55:05 user nova-compute[74482]: INFO nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt host capabilities <capabilities>
Oct 23 22:55:05 user nova-compute[74482]:   <host>
Oct 23 22:55:05 user nova-compute[74482]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 23 22:55:05 user nova-compute[74482]:     <cpu>
Oct 23 22:55:05 user nova-compute[74482]:       <arch>x86_64</arch>
Oct 23 22:55:05 user nova-compute[74482]:       <model>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <vendor>Intel</vendor>
Oct 23 22:55:05 user nova-compute[74482]:       <microcode version='1070'/>
Oct 23 22:55:05 user nova-compute[74482]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 23 22:55:05 user nova-compute[74482]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='ss'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='vmx'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='pcid'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='osxsave'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='hypervisor'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='arat'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='tsc_adjust'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='md-clear'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='arch-capabilities'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='invtsc'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='rsba'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature name='skip-l1dfl-vmentry'/>
Oct 23 22:55:05 user nova-compute[74482]:       <pages unit='KiB' size='4'/>
Oct 23 22:55:05 user nova-compute[74482]:       <pages unit='KiB' size='2048'/>
Oct 23 22:55:05 user nova-compute[74482]:     </cpu>
Oct 23 22:55:05 user nova-compute[74482]:     <power_management>
Oct 23 22:55:05 user nova-compute[74482]:       <suspend_mem/>
Oct 23 22:55:05 user nova-compute[74482]:       <suspend_disk/>
Oct 23 22:55:05 user nova-compute[74482]:       <suspend_hybrid/>
Oct 23 22:55:05 user nova-compute[74482]:     </power_management>
Oct 23 22:55:05 user nova-compute[74482]:     <iommu support='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     <migration_features>
Oct 23 22:55:05 user nova-compute[74482]:       <live/>
Oct 23 22:55:05 user nova-compute[74482]:       <uri_transports>
Oct 23 22:55:05 user nova-compute[74482]:         <uri_transport>tcp</uri_transport>
Oct 23 22:55:05 user nova-compute[74482]:         <uri_transport>rdma</uri_transport>
Oct 23 22:55:05 user nova-compute[74482]:       </uri_transports>
Oct 23 22:55:05 user nova-compute[74482]:     </migration_features>
Oct 23 22:55:05 user nova-compute[74482]:     <topology>
Oct 23 22:55:05 user nova-compute[74482]:       <cells num='2'>
Oct 23 22:55:05 user nova-compute[74482]:         <cell id='0'>
Oct 23 22:55:05 user nova-compute[74482]:           <memory unit='KiB'>8140616</memory>
Oct 23 22:55:05 user nova-compute[74482]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 23 22:55:05 user nova-compute[74482]:           <pages unit='KiB' size='2048'>0</pages>
Oct 23 22:55:05 user nova-compute[74482]:           <distances>
Oct 23 22:55:05 user nova-compute[74482]:             <sibling id='0' value='10'/>
Oct 23 22:55:05 user nova-compute[74482]:             <sibling id='1' value='20'/>
Oct 23 22:55:05 user nova-compute[74482]:           </distances>
Oct 23 22:55:05 user nova-compute[74482]:           <cpus num='6'>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 23 22:55:05 user nova-compute[74482]:           </cpus>
Oct 23 22:55:05 user nova-compute[74482]:         </cell>
Oct 23 22:55:05 user nova-compute[74482]:         <cell id='1'>
Oct 23 22:55:05 user nova-compute[74482]:           <memory unit='KiB'>8255068</memory>
Oct 23 22:55:05 user nova-compute[74482]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 23 22:55:05 user nova-compute[74482]:           <pages unit='KiB' size='2048'>0</pages>
Oct 23 22:55:05 user nova-compute[74482]:           <distances>
Oct 23 22:55:05 user nova-compute[74482]:             <sibling id='0' value='20'/>
Oct 23 22:55:05 user nova-compute[74482]:             <sibling id='1' value='10'/>
Oct 23 22:55:05 user nova-compute[74482]:           </distances>
Oct 23 22:55:05 user nova-compute[74482]:           <cpus num='6'>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 23 22:55:05 user nova-compute[74482]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 23 22:55:05 user nova-compute[74482]:           </cpus>
Oct 23 22:55:05 user nova-compute[74482]:         </cell>
Oct 23 22:55:05 user nova-compute[74482]:       </cells>
Oct 23 22:55:05 user nova-compute[74482]:     </topology>
Oct 23 22:55:05 user nova-compute[74482]:     <cache>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 23 22:55:05 user nova-compute[74482]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 23 22:55:05 user nova-compute[74482]:     </cache>
Oct 23 22:55:05 user nova-compute[74482]:     <secmodel>
Oct 23 22:55:05 user nova-compute[74482]:       <model>apparmor</model>
Oct 23 22:55:05 user nova-compute[74482]:       <doi>0</doi>
Oct 23 22:55:05 user nova-compute[74482]:     </secmodel>
Oct 23 22:55:05 user nova-compute[74482]:     <secmodel>
Oct 23 22:55:05 user nova-compute[74482]:       <model>dac</model>
Oct 23 22:55:05 user nova-compute[74482]:       <doi>0</doi>
Oct 23 22:55:05 user nova-compute[74482]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 23 22:55:05 user nova-compute[74482]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 23 22:55:05 user nova-compute[74482]:     </secmodel>
Oct 23 22:55:05 user nova-compute[74482]:   </host>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='alpha'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>clipper</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='armv6l'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>spitz</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>nuri</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>kzm</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sx1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>z2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>tosa</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>n810</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>n800</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>terrier</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>midway</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>microbit</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>verdex</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>highbank</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>akita</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>connex</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>collie</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='armv7l'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>spitz</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>nuri</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>kzm</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sx1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>z2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>tosa</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>n810</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>n800</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>terrier</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>midway</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>microbit</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>verdex</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>highbank</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>akita</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>connex</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>collie</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='aarch64'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>spitz</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>nuri</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>kzm</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sx1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>z2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>tosa</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>n810</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>n800</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>terrier</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>midway</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>microbit</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>verdex</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>raspi3b</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>highbank</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>akita</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>connex</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>collie</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <acpi default='on' toggle='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='cris'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='i686'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>x-remote</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>isapc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>microvm</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='kvm'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <pae/>
Oct 23 22:55:05 user nova-compute[74482]:       <nonpae/>
Oct 23 22:55:05 user nova-compute[74482]:       <acpi default='on' toggle='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:       <apic default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='m68k'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>an5206</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>q800</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>next-cube</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='microblaze'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='microblazeel'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='mips'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='16'>malta</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='mipsel'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='16'>malta</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='mips64'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='16'>malta</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>pica61</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>magnum</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='mips64el'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='16'>malta</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>pica61</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>magnum</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='16'>boston</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='ppc'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mac99</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>40p</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>taihu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='ppc64'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2048'>powernv9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>taihu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2048'>powernv10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>40p</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mac99</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2048'>powernv8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='ppc64le'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2048'>powernv9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>taihu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2048'>powernv10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>40p</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>mac99</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2048'>powernv8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='riscv32'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='8'>spike</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>opentitan</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='5'>sifive_u</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sifive_e</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='8'>virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='riscv64'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='8'>spike</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='5'>sifive_u</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>shakti_c</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sifive_e</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='8'>virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='s390x'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='sh4'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>shix</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>r2d</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='sh4eb'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>shix</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>r2d</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='sparc'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>SS-5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>SS-20</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>LX</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>SS-4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>SS-10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>Voyager</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='sparc64'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sun4u</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>niagara</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>sun4v</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='x86_64'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>64</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>x-remote</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='1'>isapc</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>microvm</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='kvm'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <acpi default='on' toggle='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:       <apic default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='xtensa'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>sim</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>kc705</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>ml605</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>lx200</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>lx60</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]:   <guest>
Oct 23 22:55:05 user nova-compute[74482]:     <os_type>hvm</os_type>
Oct 23 22:55:05 user nova-compute[74482]:     <arch name='xtensaeb'>
Oct 23 22:55:05 user nova-compute[74482]:       <wordsize>32</wordsize>
Oct 23 22:55:05 user nova-compute[74482]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='4'>sim</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>kc705</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>ml605</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>virt</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>lx200</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>lx60</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 23 22:55:05 user nova-compute[74482]:       <domain type='qemu'/>
Oct 23 22:55:05 user nova-compute[74482]:     </arch>
Oct 23 22:55:05 user nova-compute[74482]:     <features>
Oct 23 22:55:05 user nova-compute[74482]:       <cpuselection/>
Oct 23 22:55:05 user nova-compute[74482]:       <deviceboot/>
Oct 23 22:55:05 user nova-compute[74482]:       <disksnapshot default='on' toggle='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     </features>
Oct 23 22:55:05 user nova-compute[74482]:   </guest>
Oct 23 22:55:05 user nova-compute[74482]: </capabilities>
Oct 23 22:55:05 user nova-compute[74482]: 
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 23 22:55:05 user nova-compute[74482]: <domainCapabilities>
Oct 23 22:55:05 user nova-compute[74482]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 22:55:05 user nova-compute[74482]:   <domain>kvm</domain>
Oct 23 22:55:05 user nova-compute[74482]:   <machine>pc-i440fx-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:   <arch>i686</arch>
Oct 23 22:55:05 user nova-compute[74482]:   <vcpu max='255'/>
Oct 23 22:55:05 user nova-compute[74482]:   <iothreads supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:   <os supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='firmware'/>
Oct 23 22:55:05 user nova-compute[74482]:     <loader supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>rom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pflash</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='readonly'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='secure'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </loader>
Oct 23 22:55:05 user nova-compute[74482]:   </os>
Oct 23 22:55:05 user nova-compute[74482]:   <cpu>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-passthrough' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='hostPassthroughMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='maximum' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='maximumMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-model' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <vendor>Intel</vendor>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ss'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='vmx'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='pcid'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='hypervisor'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arat'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='umip'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='md-clear'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibpb'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibrs'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='erms'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='lm'/>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='custom' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>qemu64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>qemu32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>phenom</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>n270</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>kvm64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>kvm32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>coreduo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>core2duo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>athlon</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Westmere</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Snowridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Penryn</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G5</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G4</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G1</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Nehalem</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Rome</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Milan</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Dhyana</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cooperlake</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Conroe</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>486</model>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:   </cpu>
Oct 23 22:55:05 user nova-compute[74482]:   <memoryBacking supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='sourceType'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>file</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>anonymous</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>memfd</value>
Oct 23 22:55:05 user nova-compute[74482]:     </enum>
Oct 23 22:55:05 user nova-compute[74482]:   </memoryBacking>
Oct 23 22:55:05 user nova-compute[74482]:   <devices>
Oct 23 22:55:05 user nova-compute[74482]:     <disk supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='diskDevice'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>disk</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cdrom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>floppy</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>lun</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='bus'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>ide</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>fdc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sata</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </disk>
Oct 23 22:55:05 user nova-compute[74482]:     <graphics supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sdl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vnc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>spice</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egl-headless</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </graphics>
Oct 23 22:55:05 user nova-compute[74482]:     <video supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='modelType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cirrus</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vmvga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>qxl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>none</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>bochs</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>ramfb</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </video>
Oct 23 22:55:05 user nova-compute[74482]:     <hostdev supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='mode'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>subsystem</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='startupPolicy'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>default</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>mandatory</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>requisite</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>optional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='subsysType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pci</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='capsType'/>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='pciBackend'/>
Oct 23 22:55:05 user nova-compute[74482]:     </hostdev>
Oct 23 22:55:05 user nova-compute[74482]:     <rng supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>random</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egd</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>builtin</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </rng>
Oct 23 22:55:05 user nova-compute[74482]:     <filesystem supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='driverType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>path</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>handle</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtiofs</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </filesystem>
Oct 23 22:55:05 user nova-compute[74482]:     <tpm supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-tis</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-crb</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>passthrough</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>emulator</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </tpm>
Oct 23 22:55:05 user nova-compute[74482]:   </devices>
Oct 23 22:55:05 user nova-compute[74482]:   <features>
Oct 23 22:55:05 user nova-compute[74482]:     <gic supported='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     <vmcoreinfo supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <genid supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <backingStoreInput supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <backup supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <sev supported='no'/>
Oct 23 22:55:05 user nova-compute[74482]:   </features>
Oct 23 22:55:05 user nova-compute[74482]: </domainCapabilities>
Oct 23 22:55:05 user nova-compute[74482]:  {{(pid=74482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 23 22:55:05 user nova-compute[74482]: <domainCapabilities>
Oct 23 22:55:05 user nova-compute[74482]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 22:55:05 user nova-compute[74482]:   <domain>kvm</domain>
Oct 23 22:55:05 user nova-compute[74482]:   <machine>pc-q35-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:   <arch>i686</arch>
Oct 23 22:55:05 user nova-compute[74482]:   <vcpu max='288'/>
Oct 23 22:55:05 user nova-compute[74482]:   <iothreads supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:   <os supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='firmware'/>
Oct 23 22:55:05 user nova-compute[74482]:     <loader supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>rom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pflash</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='readonly'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='secure'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </loader>
Oct 23 22:55:05 user nova-compute[74482]:   </os>
Oct 23 22:55:05 user nova-compute[74482]:   <cpu>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-passthrough' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='hostPassthroughMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='maximum' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='maximumMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-model' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <vendor>Intel</vendor>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ss'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='vmx'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='pcid'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='hypervisor'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arat'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='umip'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='md-clear'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibpb'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibrs'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='erms'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='lm'/>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='custom' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>qemu64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>qemu32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>phenom</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>n270</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>kvm64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>kvm32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>coreduo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>core2duo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>athlon</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Westmere</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Snowridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Penryn</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G5</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G4</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G1</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Nehalem</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Rome</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Milan</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Dhyana</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cooperlake</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Conroe</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>486</model>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:   </cpu>
Oct 23 22:55:05 user nova-compute[74482]:   <memoryBacking supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='sourceType'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>file</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>anonymous</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>memfd</value>
Oct 23 22:55:05 user nova-compute[74482]:     </enum>
Oct 23 22:55:05 user nova-compute[74482]:   </memoryBacking>
Oct 23 22:55:05 user nova-compute[74482]:   <devices>
Oct 23 22:55:05 user nova-compute[74482]:     <disk supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='diskDevice'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>disk</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cdrom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>floppy</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>lun</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='bus'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>fdc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sata</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </disk>
Oct 23 22:55:05 user nova-compute[74482]:     <graphics supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sdl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vnc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>spice</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egl-headless</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </graphics>
Oct 23 22:55:05 user nova-compute[74482]:     <video supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='modelType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cirrus</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vmvga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>qxl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>none</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>bochs</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>ramfb</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </video>
Oct 23 22:55:05 user nova-compute[74482]:     <hostdev supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='mode'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>subsystem</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='startupPolicy'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>default</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>mandatory</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>requisite</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>optional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='subsysType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pci</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='capsType'/>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='pciBackend'/>
Oct 23 22:55:05 user nova-compute[74482]:     </hostdev>
Oct 23 22:55:05 user nova-compute[74482]:     <rng supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>random</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egd</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>builtin</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </rng>
Oct 23 22:55:05 user nova-compute[74482]:     <filesystem supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='driverType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>path</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>handle</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtiofs</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </filesystem>
Oct 23 22:55:05 user nova-compute[74482]:     <tpm supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-tis</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-crb</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>passthrough</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>emulator</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </tpm>
Oct 23 22:55:05 user nova-compute[74482]:   </devices>
Oct 23 22:55:05 user nova-compute[74482]:   <features>
Oct 23 22:55:05 user nova-compute[74482]:     <gic supported='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     <vmcoreinfo supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <genid supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <backingStoreInput supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <backup supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <sev supported='no'/>
Oct 23 22:55:05 user nova-compute[74482]:   </features>
Oct 23 22:55:05 user nova-compute[74482]: </domainCapabilities>
Oct 23 22:55:05 user nova-compute[74482]:  {{(pid=74482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 23 22:55:05 user nova-compute[74482]: <domainCapabilities>
Oct 23 22:55:05 user nova-compute[74482]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 22:55:05 user nova-compute[74482]:   <domain>kvm</domain>
Oct 23 22:55:05 user nova-compute[74482]:   <machine>pc-i440fx-6.2</machine>
Oct 23 22:55:05 user nova-compute[74482]:   <arch>i686</arch>
Oct 23 22:55:05 user nova-compute[74482]:   <vcpu max='255'/>
Oct 23 22:55:05 user nova-compute[74482]:   <iothreads supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:   <os supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='firmware'/>
Oct 23 22:55:05 user nova-compute[74482]:     <loader supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>rom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pflash</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='readonly'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='secure'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </loader>
Oct 23 22:55:05 user nova-compute[74482]:   </os>
Oct 23 22:55:05 user nova-compute[74482]:   <cpu>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-passthrough' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='hostPassthroughMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='maximum' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='maximumMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-model' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <vendor>Intel</vendor>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ss'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='vmx'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='pcid'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='hypervisor'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arat'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='umip'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='md-clear'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibpb'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibrs'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='erms'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='lm'/>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='custom' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>qemu64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>qemu32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>phenom</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>n270</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>kvm64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>kvm32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>coreduo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>core2duo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>athlon</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Westmere</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Snowridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Penryn</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G5</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G4</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G1</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Nehalem</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Rome</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Milan</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Dhyana</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cooperlake</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Conroe</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>486</model>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:   </cpu>
Oct 23 22:55:05 user nova-compute[74482]:   <memoryBacking supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='sourceType'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>file</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>anonymous</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>memfd</value>
Oct 23 22:55:05 user nova-compute[74482]:     </enum>
Oct 23 22:55:05 user nova-compute[74482]:   </memoryBacking>
Oct 23 22:55:05 user nova-compute[74482]:   <devices>
Oct 23 22:55:05 user nova-compute[74482]:     <disk supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='diskDevice'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>disk</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cdrom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>floppy</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>lun</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='bus'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>ide</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>fdc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sata</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </disk>
Oct 23 22:55:05 user nova-compute[74482]:     <graphics supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sdl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vnc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>spice</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egl-headless</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </graphics>
Oct 23 22:55:05 user nova-compute[74482]:     <video supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='modelType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cirrus</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vmvga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>qxl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>none</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>bochs</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>ramfb</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </video>
Oct 23 22:55:05 user nova-compute[74482]:     <hostdev supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='mode'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>subsystem</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='startupPolicy'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>default</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>mandatory</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>requisite</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>optional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='subsysType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pci</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='capsType'/>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='pciBackend'/>
Oct 23 22:55:05 user nova-compute[74482]:     </hostdev>
Oct 23 22:55:05 user nova-compute[74482]:     <rng supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>random</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egd</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>builtin</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </rng>
Oct 23 22:55:05 user nova-compute[74482]:     <filesystem supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='driverType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>path</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>handle</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtiofs</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </filesystem>
Oct 23 22:55:05 user nova-compute[74482]:     <tpm supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-tis</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-crb</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>passthrough</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>emulator</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </tpm>
Oct 23 22:55:05 user nova-compute[74482]:   </devices>
Oct 23 22:55:05 user nova-compute[74482]:   <features>
Oct 23 22:55:05 user nova-compute[74482]:     <gic supported='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     <vmcoreinfo supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <genid supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <backingStoreInput supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <backup supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <sev supported='no'/>
Oct 23 22:55:05 user nova-compute[74482]:   </features>
Oct 23 22:55:05 user nova-compute[74482]: </domainCapabilities>
Oct 23 22:55:05 user nova-compute[74482]:  {{(pid=74482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 23 22:55:05 user nova-compute[74482]: <domainCapabilities>
Oct 23 22:55:05 user nova-compute[74482]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 22:55:05 user nova-compute[74482]:   <domain>kvm</domain>
Oct 23 22:55:05 user nova-compute[74482]:   <machine>pc-q35-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:   <arch>i686</arch>
Oct 23 22:55:05 user nova-compute[74482]:   <vcpu max='288'/>
Oct 23 22:55:05 user nova-compute[74482]:   <iothreads supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:   <os supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='firmware'/>
Oct 23 22:55:05 user nova-compute[74482]:     <loader supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>rom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pflash</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='readonly'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='secure'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </loader>
Oct 23 22:55:05 user nova-compute[74482]:   </os>
Oct 23 22:55:05 user nova-compute[74482]:   <cpu>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-passthrough' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='hostPassthroughMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='maximum' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='maximumMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-model' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <vendor>Intel</vendor>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ss'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='vmx'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='pcid'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='hypervisor'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arat'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='umip'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='md-clear'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibpb'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibrs'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='erms'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='lm'/>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='custom' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>qemu64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>qemu32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>phenom</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>n270</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>kvm64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>kvm32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>coreduo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>core2duo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>athlon</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Westmere</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Snowridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Penryn</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G5</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G4</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G1</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Nehalem</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Rome</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Milan</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Dhyana</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cooperlake</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Conroe</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>486</model>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:   </cpu>
Oct 23 22:55:05 user nova-compute[74482]:   <memoryBacking supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='sourceType'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>file</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>anonymous</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>memfd</value>
Oct 23 22:55:05 user nova-compute[74482]:     </enum>
Oct 23 22:55:05 user nova-compute[74482]:   </memoryBacking>
Oct 23 22:55:05 user nova-compute[74482]:   <devices>
Oct 23 22:55:05 user nova-compute[74482]:     <disk supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='diskDevice'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>disk</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cdrom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>floppy</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>lun</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='bus'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>fdc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sata</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </disk>
Oct 23 22:55:05 user nova-compute[74482]:     <graphics supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sdl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vnc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>spice</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egl-headless</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </graphics>
Oct 23 22:55:05 user nova-compute[74482]:     <video supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='modelType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cirrus</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vmvga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>qxl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>none</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>bochs</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>ramfb</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </video>
Oct 23 22:55:05 user nova-compute[74482]:     <hostdev supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='mode'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>subsystem</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='startupPolicy'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>default</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>mandatory</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>requisite</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>optional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='subsysType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pci</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='capsType'/>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='pciBackend'/>
Oct 23 22:55:05 user nova-compute[74482]:     </hostdev>
Oct 23 22:55:05 user nova-compute[74482]:     <rng supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>random</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egd</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>builtin</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </rng>
Oct 23 22:55:05 user nova-compute[74482]:     <filesystem supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='driverType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>path</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>handle</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtiofs</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </filesystem>
Oct 23 22:55:05 user nova-compute[74482]:     <tpm supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-tis</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-crb</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>passthrough</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>emulator</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </tpm>
Oct 23 22:55:05 user nova-compute[74482]:   </devices>
Oct 23 22:55:05 user nova-compute[74482]:   <features>
Oct 23 22:55:05 user nova-compute[74482]:     <gic supported='no'/>
Oct 23 22:55:05 user nova-compute[74482]:     <vmcoreinfo supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <genid supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <backingStoreInput supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <backup supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:     <sev supported='no'/>
Oct 23 22:55:05 user nova-compute[74482]:   </features>
Oct 23 22:55:05 user nova-compute[74482]: </domainCapabilities>
Oct 23 22:55:05 user nova-compute[74482]:  {{(pid=74482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 23 22:55:05 user nova-compute[74482]: <domainCapabilities>
Oct 23 22:55:05 user nova-compute[74482]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 22:55:05 user nova-compute[74482]:   <domain>kvm</domain>
Oct 23 22:55:05 user nova-compute[74482]:   <machine>pc-i440fx-jammy</machine>
Oct 23 22:55:05 user nova-compute[74482]:   <arch>x86_64</arch>
Oct 23 22:55:05 user nova-compute[74482]:   <vcpu max='255'/>
Oct 23 22:55:05 user nova-compute[74482]:   <iothreads supported='yes'/>
Oct 23 22:55:05 user nova-compute[74482]:   <os supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='firmware'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>efi</value>
Oct 23 22:55:05 user nova-compute[74482]:     </enum>
Oct 23 22:55:05 user nova-compute[74482]:     <loader supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>rom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pflash</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='readonly'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='secure'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </loader>
Oct 23 22:55:05 user nova-compute[74482]:   </os>
Oct 23 22:55:05 user nova-compute[74482]:   <cpu>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-passthrough' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='hostPassthroughMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='maximum' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='maximumMigratable'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='host-model' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <vendor>Intel</vendor>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ss'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='vmx'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='pcid'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='hypervisor'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arat'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='umip'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='md-clear'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='invtsc'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibpb'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='ibrs'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-stibp'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='rsba'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='erms'/>
Oct 23 22:55:05 user nova-compute[74482]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:     <mode name='custom' supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>qemu64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>qemu32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>phenom</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>pentium</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>n270</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>kvm64</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>kvm32</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>coreduo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>core2duo</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>athlon</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>Westmere</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Snowridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Skylake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>SandyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>Penryn</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G5</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G4</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G3</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Opteron_G2</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>Opteron_G1</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>Nehalem</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>IvyBridge</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Icelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Haswell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Rome</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-Milan</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>EPYC</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Dhyana</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cooperlake</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>Conroe</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='no'>Broadwell</model>
Oct 23 22:55:05 user nova-compute[74482]:       <model usable='yes'>486</model>
Oct 23 22:55:05 user nova-compute[74482]:     </mode>
Oct 23 22:55:05 user nova-compute[74482]:   </cpu>
Oct 23 22:55:05 user nova-compute[74482]:   <memoryBacking supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:     <enum name='sourceType'>
Oct 23 22:55:05 user nova-compute[74482]:       <value>file</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>anonymous</value>
Oct 23 22:55:05 user nova-compute[74482]:       <value>memfd</value>
Oct 23 22:55:05 user nova-compute[74482]:     </enum>
Oct 23 22:55:05 user nova-compute[74482]:   </memoryBacking>
Oct 23 22:55:05 user nova-compute[74482]:   <devices>
Oct 23 22:55:05 user nova-compute[74482]:     <disk supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='diskDevice'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>disk</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cdrom</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>floppy</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>lun</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='bus'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>ide</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>fdc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sata</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </disk>
Oct 23 22:55:05 user nova-compute[74482]:     <graphics supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>sdl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vnc</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>spice</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egl-headless</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </graphics>
Oct 23 22:55:05 user nova-compute[74482]:     <video supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='modelType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>cirrus</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>vmvga</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>qxl</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>none</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>bochs</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>ramfb</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </video>
Oct 23 22:55:05 user nova-compute[74482]:     <hostdev supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='mode'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>subsystem</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='startupPolicy'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>default</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>mandatory</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>requisite</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>optional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='subsysType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>pci</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='capsType'/>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='pciBackend'/>
Oct 23 22:55:05 user nova-compute[74482]:     </hostdev>
Oct 23 22:55:05 user nova-compute[74482]:     <rng supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>random</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>egd</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>builtin</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </rng>
Oct 23 22:55:05 user nova-compute[74482]:     <filesystem supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='driverType'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>path</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>handle</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>virtiofs</value>
Oct 23 22:55:05 user nova-compute[74482]:       </enum>
Oct 23 22:55:05 user nova-compute[74482]:     </filesystem>
Oct 23 22:55:05 user nova-compute[74482]:     <tpm supported='yes'>
Oct 23 22:55:05 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-tis</value>
Oct 23 22:55:05 user nova-compute[74482]:         <value>tpm-crb</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>passthrough</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>emulator</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </tpm>
Oct 23 22:55:06 user nova-compute[74482]:   </devices>
Oct 23 22:55:06 user nova-compute[74482]:   <features>
Oct 23 22:55:06 user nova-compute[74482]:     <gic supported='no'/>
Oct 23 22:55:06 user nova-compute[74482]:     <vmcoreinfo supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <genid supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <backingStoreInput supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <backup supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <sev supported='no'/>
Oct 23 22:55:06 user nova-compute[74482]:   </features>
Oct 23 22:55:06 user nova-compute[74482]: </domainCapabilities>
Oct 23 22:55:06 user nova-compute[74482]:  {{(pid=74482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 23 22:55:06 user nova-compute[74482]: <domainCapabilities>
Oct 23 22:55:06 user nova-compute[74482]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 22:55:06 user nova-compute[74482]:   <domain>kvm</domain>
Oct 23 22:55:06 user nova-compute[74482]:   <machine>pc-q35-6.2</machine>
Oct 23 22:55:06 user nova-compute[74482]:   <arch>x86_64</arch>
Oct 23 22:55:06 user nova-compute[74482]:   <vcpu max='288'/>
Oct 23 22:55:06 user nova-compute[74482]:   <iothreads supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:   <os supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:     <enum name='firmware'>
Oct 23 22:55:06 user nova-compute[74482]:       <value>efi</value>
Oct 23 22:55:06 user nova-compute[74482]:     </enum>
Oct 23 22:55:06 user nova-compute[74482]:     <loader supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>rom</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>pflash</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='readonly'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='secure'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </loader>
Oct 23 22:55:06 user nova-compute[74482]:   </os>
Oct 23 22:55:06 user nova-compute[74482]:   <cpu>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='host-passthrough' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='hostPassthroughMigratable'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='maximum' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='maximumMigratable'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='host-model' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <vendor>Intel</vendor>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ss'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='vmx'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='pcid'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='hypervisor'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='arat'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='umip'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='md-clear'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='stibp'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ssbd'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='invtsc'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ibpb'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ibrs'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='amd-stibp'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='rsba'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='disable' name='erms'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='custom' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>qemu64</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>qemu32</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>phenom</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>pentium3</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>pentium2</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>pentium</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>n270</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>kvm64</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>kvm32</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>coreduo</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>core2duo</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>athlon</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Westmere</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Snowridge</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Server</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Client</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>SandyBridge</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Penryn</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G5</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G4</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G3</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G2</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Opteron_G1</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Nehalem</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>IvyBridge</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Icelake-Server</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC-Rome</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC-Milan</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Dhyana</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Cooperlake</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Conroe</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>486</model>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:   </cpu>
Oct 23 22:55:06 user nova-compute[74482]:   <memoryBacking supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:     <enum name='sourceType'>
Oct 23 22:55:06 user nova-compute[74482]:       <value>file</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>anonymous</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>memfd</value>
Oct 23 22:55:06 user nova-compute[74482]:     </enum>
Oct 23 22:55:06 user nova-compute[74482]:   </memoryBacking>
Oct 23 22:55:06 user nova-compute[74482]:   <devices>
Oct 23 22:55:06 user nova-compute[74482]:     <disk supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='diskDevice'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>disk</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>cdrom</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>floppy</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>lun</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='bus'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>fdc</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>sata</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </disk>
Oct 23 22:55:06 user nova-compute[74482]:     <graphics supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>sdl</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>vnc</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>spice</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>egl-headless</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </graphics>
Oct 23 22:55:06 user nova-compute[74482]:     <video supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='modelType'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>vga</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>cirrus</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>vmvga</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>qxl</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>none</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>bochs</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>ramfb</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </video>
Oct 23 22:55:06 user nova-compute[74482]:     <hostdev supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='mode'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>subsystem</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='startupPolicy'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>default</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>mandatory</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>requisite</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>optional</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='subsysType'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>pci</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='capsType'/>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='pciBackend'/>
Oct 23 22:55:06 user nova-compute[74482]:     </hostdev>
Oct 23 22:55:06 user nova-compute[74482]:     <rng supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>random</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>egd</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>builtin</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </rng>
Oct 23 22:55:06 user nova-compute[74482]:     <filesystem supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='driverType'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>path</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>handle</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtiofs</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </filesystem>
Oct 23 22:55:06 user nova-compute[74482]:     <tpm supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>tpm-tis</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>tpm-crb</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>passthrough</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>emulator</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </tpm>
Oct 23 22:55:06 user nova-compute[74482]:   </devices>
Oct 23 22:55:06 user nova-compute[74482]:   <features>
Oct 23 22:55:06 user nova-compute[74482]:     <gic supported='no'/>
Oct 23 22:55:06 user nova-compute[74482]:     <vmcoreinfo supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <genid supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <backingStoreInput supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <backup supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <sev supported='no'/>
Oct 23 22:55:06 user nova-compute[74482]:   </features>
Oct 23 22:55:06 user nova-compute[74482]: </domainCapabilities>
Oct 23 22:55:06 user nova-compute[74482]:  {{(pid=74482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 23 22:55:06 user nova-compute[74482]: <domainCapabilities>
Oct 23 22:55:06 user nova-compute[74482]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 22:55:06 user nova-compute[74482]:   <domain>kvm</domain>
Oct 23 22:55:06 user nova-compute[74482]:   <machine>pc-i440fx-6.2</machine>
Oct 23 22:55:06 user nova-compute[74482]:   <arch>x86_64</arch>
Oct 23 22:55:06 user nova-compute[74482]:   <vcpu max='255'/>
Oct 23 22:55:06 user nova-compute[74482]:   <iothreads supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:   <os supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:     <enum name='firmware'>
Oct 23 22:55:06 user nova-compute[74482]:       <value>efi</value>
Oct 23 22:55:06 user nova-compute[74482]:     </enum>
Oct 23 22:55:06 user nova-compute[74482]:     <loader supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>rom</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>pflash</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='readonly'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='secure'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </loader>
Oct 23 22:55:06 user nova-compute[74482]:   </os>
Oct 23 22:55:06 user nova-compute[74482]:   <cpu>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='host-passthrough' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='hostPassthroughMigratable'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='maximum' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='maximumMigratable'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='host-model' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <vendor>Intel</vendor>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ss'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='vmx'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='pcid'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='hypervisor'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='arat'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='umip'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='md-clear'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='stibp'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ssbd'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='invtsc'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ibpb'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ibrs'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='amd-stibp'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='rsba'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='disable' name='erms'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='custom' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>qemu64</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>qemu32</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>phenom</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>pentium3</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>pentium2</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>pentium</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>n270</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>kvm64</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>kvm32</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>coreduo</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>core2duo</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>athlon</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Westmere</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Snowridge</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Server</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Client</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>SandyBridge</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Penryn</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G5</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G4</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G3</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G2</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Opteron_G1</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Nehalem</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>IvyBridge</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Icelake-Server</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC-Rome</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC-Milan</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Dhyana</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Cooperlake</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Conroe</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>486</model>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:   </cpu>
Oct 23 22:55:06 user nova-compute[74482]:   <memoryBacking supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:     <enum name='sourceType'>
Oct 23 22:55:06 user nova-compute[74482]:       <value>file</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>anonymous</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>memfd</value>
Oct 23 22:55:06 user nova-compute[74482]:     </enum>
Oct 23 22:55:06 user nova-compute[74482]:   </memoryBacking>
Oct 23 22:55:06 user nova-compute[74482]:   <devices>
Oct 23 22:55:06 user nova-compute[74482]:     <disk supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='diskDevice'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>disk</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>cdrom</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>floppy</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>lun</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='bus'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>ide</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>fdc</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>sata</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </disk>
Oct 23 22:55:06 user nova-compute[74482]:     <graphics supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>sdl</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>vnc</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>spice</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>egl-headless</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </graphics>
Oct 23 22:55:06 user nova-compute[74482]:     <video supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='modelType'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>vga</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>cirrus</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>vmvga</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>qxl</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>none</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>bochs</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>ramfb</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </video>
Oct 23 22:55:06 user nova-compute[74482]:     <hostdev supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='mode'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>subsystem</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='startupPolicy'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>default</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>mandatory</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>requisite</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>optional</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='subsysType'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>pci</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='capsType'/>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='pciBackend'/>
Oct 23 22:55:06 user nova-compute[74482]:     </hostdev>
Oct 23 22:55:06 user nova-compute[74482]:     <rng supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>random</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>egd</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>builtin</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </rng>
Oct 23 22:55:06 user nova-compute[74482]:     <filesystem supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='driverType'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>path</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>handle</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtiofs</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </filesystem>
Oct 23 22:55:06 user nova-compute[74482]:     <tpm supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>tpm-tis</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>tpm-crb</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>passthrough</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>emulator</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </tpm>
Oct 23 22:55:06 user nova-compute[74482]:   </devices>
Oct 23 22:55:06 user nova-compute[74482]:   <features>
Oct 23 22:55:06 user nova-compute[74482]:     <gic supported='no'/>
Oct 23 22:55:06 user nova-compute[74482]:     <vmcoreinfo supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <genid supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <backingStoreInput supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <backup supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <sev supported='no'/>
Oct 23 22:55:06 user nova-compute[74482]:   </features>
Oct 23 22:55:06 user nova-compute[74482]: </domainCapabilities>
Oct 23 22:55:06 user nova-compute[74482]:  {{(pid=74482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 23 22:55:06 user nova-compute[74482]: <domainCapabilities>
Oct 23 22:55:06 user nova-compute[74482]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 22:55:06 user nova-compute[74482]:   <domain>kvm</domain>
Oct 23 22:55:06 user nova-compute[74482]:   <machine>pc-q35-jammy</machine>
Oct 23 22:55:06 user nova-compute[74482]:   <arch>x86_64</arch>
Oct 23 22:55:06 user nova-compute[74482]:   <vcpu max='288'/>
Oct 23 22:55:06 user nova-compute[74482]:   <iothreads supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:   <os supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:     <enum name='firmware'>
Oct 23 22:55:06 user nova-compute[74482]:       <value>efi</value>
Oct 23 22:55:06 user nova-compute[74482]:     </enum>
Oct 23 22:55:06 user nova-compute[74482]:     <loader supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>rom</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>pflash</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='readonly'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='secure'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>yes</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>no</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </loader>
Oct 23 22:55:06 user nova-compute[74482]:   </os>
Oct 23 22:55:06 user nova-compute[74482]:   <cpu>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='host-passthrough' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='hostPassthroughMigratable'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='maximum' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='maximumMigratable'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>on</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>off</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='host-model' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <vendor>Intel</vendor>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ss'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='vmx'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='pcid'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='hypervisor'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='arat'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='umip'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='md-clear'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='stibp'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ssbd'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='invtsc'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ibpb'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='ibrs'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='amd-stibp'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='rsba'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='disable' name='erms'/>
Oct 23 22:55:06 user nova-compute[74482]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:     <mode name='custom' supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>qemu64</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>qemu32</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>phenom</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>pentium3</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>pentium2</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>pentium</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>n270</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>kvm64</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>kvm32</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>coreduo</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>core2duo</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>athlon</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Westmere</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Snowridge</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Server</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Skylake-Client</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>SandyBridge</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Penryn</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G5</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G4</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G3</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Opteron_G2</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Opteron_G1</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Nehalem</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>IvyBridge</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Icelake-Server</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Haswell</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC-Rome</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC-Milan</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>EPYC</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Dhyana</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Cooperlake</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>Conroe</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='no'>Broadwell</model>
Oct 23 22:55:06 user nova-compute[74482]:       <model usable='yes'>486</model>
Oct 23 22:55:06 user nova-compute[74482]:     </mode>
Oct 23 22:55:06 user nova-compute[74482]:   </cpu>
Oct 23 22:55:06 user nova-compute[74482]:   <memoryBacking supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:     <enum name='sourceType'>
Oct 23 22:55:06 user nova-compute[74482]:       <value>file</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>anonymous</value>
Oct 23 22:55:06 user nova-compute[74482]:       <value>memfd</value>
Oct 23 22:55:06 user nova-compute[74482]:     </enum>
Oct 23 22:55:06 user nova-compute[74482]:   </memoryBacking>
Oct 23 22:55:06 user nova-compute[74482]:   <devices>
Oct 23 22:55:06 user nova-compute[74482]:     <disk supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='diskDevice'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>disk</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>cdrom</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>floppy</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>lun</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='bus'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>fdc</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>sata</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </disk>
Oct 23 22:55:06 user nova-compute[74482]:     <graphics supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='type'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>sdl</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>vnc</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>spice</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>egl-headless</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </graphics>
Oct 23 22:55:06 user nova-compute[74482]:     <video supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='modelType'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>vga</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>cirrus</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>vmvga</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>qxl</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>none</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>bochs</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>ramfb</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </video>
Oct 23 22:55:06 user nova-compute[74482]:     <hostdev supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='mode'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>subsystem</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='startupPolicy'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>default</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>mandatory</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>requisite</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>optional</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='subsysType'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>usb</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>pci</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>scsi</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='capsType'/>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='pciBackend'/>
Oct 23 22:55:06 user nova-compute[74482]:     </hostdev>
Oct 23 22:55:06 user nova-compute[74482]:     <rng supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtio-non-transitional</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>random</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>egd</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>builtin</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </rng>
Oct 23 22:55:06 user nova-compute[74482]:     <filesystem supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='driverType'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>path</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>handle</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>virtiofs</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </filesystem>
Oct 23 22:55:06 user nova-compute[74482]:     <tpm supported='yes'>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='model'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>tpm-tis</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>tpm-crb</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:       <enum name='backendModel'>
Oct 23 22:55:06 user nova-compute[74482]:         <value>passthrough</value>
Oct 23 22:55:06 user nova-compute[74482]:         <value>emulator</value>
Oct 23 22:55:06 user nova-compute[74482]:       </enum>
Oct 23 22:55:06 user nova-compute[74482]:     </tpm>
Oct 23 22:55:06 user nova-compute[74482]:   </devices>
Oct 23 22:55:06 user nova-compute[74482]:   <features>
Oct 23 22:55:06 user nova-compute[74482]:     <gic supported='no'/>
Oct 23 22:55:06 user nova-compute[74482]:     <vmcoreinfo supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <genid supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <backingStoreInput supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <backup supported='yes'/>
Oct 23 22:55:06 user nova-compute[74482]:     <sev supported='no'/>
Oct 23 22:55:06 user nova-compute[74482]:   </features>
Oct 23 22:55:06 user nova-compute[74482]: </domainCapabilities>
Oct 23 22:55:06 user nova-compute[74482]:  {{(pid=74482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74482) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74482) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Checking secure boot support for host arch (x86_64) {{(pid=74482) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 22:55:06 user nova-compute[74482]: INFO nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Secure Boot support detected
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] cpu compare xml: <cpu match="exact">
Oct 23 22:55:06 user nova-compute[74482]:   <model>Nehalem</model>
Oct 23 22:55:06 user nova-compute[74482]: </cpu>
Oct 23 22:55:06 user nova-compute[74482]:  {{(pid=74482) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 23 22:55:06 user nova-compute[74482]: INFO nova.virt.node [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Generated node identity 1a363ec4-e397-463d-b641-d9da25942aa6
Oct 23 22:55:06 user nova-compute[74482]: INFO nova.virt.node [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Wrote node identity 1a363ec4-e397-463d-b641-d9da25942aa6 to /opt/stack/data/nova/compute_id
Oct 23 22:55:06 user nova-compute[74482]: WARNING nova.compute.manager [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Compute nodes ['1a363ec4-e397-463d-b641-d9da25942aa6'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 23 22:55:06 user nova-compute[74482]: INFO nova.compute.manager [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 23 22:55:06 user nova-compute[74482]: WARNING nova.compute.manager [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 23 22:55:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:55:06 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:55:06 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Hypervisor/Node resource view: name=user free_ram=10960MB free_disk=26.062015533447266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:55:06 user nova-compute[74482]: WARNING nova.compute.resource_tracker [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] No compute node record for user:1a363ec4-e397-463d-b641-d9da25942aa6: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 1a363ec4-e397-463d-b641-d9da25942aa6 could not be found.
Oct 23 22:55:06 user nova-compute[74482]: INFO nova.compute.resource_tracker [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Compute node record created for user:user with uuid: 1a363ec4-e397-463d-b641-d9da25942aa6
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:55:06 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] [req-d7d89de2-3fd3-4168-b233-6b37727b72df] Created resource provider record via placement API for resource provider with UUID 1a363ec4-e397-463d-b641-d9da25942aa6 and name user.
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74482) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 23 22:55:06 user nova-compute[74482]: INFO nova.virt.libvirt.host [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] kernel doesn't support AMD SEV
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Libvirt baseline CPU <cpu>
Oct 23 22:55:06 user nova-compute[74482]:   <arch>x86_64</arch>
Oct 23 22:55:06 user nova-compute[74482]:   <model>Nehalem</model>
Oct 23 22:55:06 user nova-compute[74482]:   <vendor>Intel</vendor>
Oct 23 22:55:06 user nova-compute[74482]:   <topology sockets="6" cores="1" threads="1"/>
Oct 23 22:55:06 user nova-compute[74482]: </cpu>
Oct 23 22:55:06 user nova-compute[74482]:  {{(pid=74482) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Updated inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Updating resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 generation from 0 to 1 during operation: update_inventory {{(pid=74482) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 23 22:55:06 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 22:55:07 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Updating resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 generation from 1 to 2 during operation: update_traits {{(pid=74482) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 23 22:55:07 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:55:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:55:07 user nova-compute[74482]: DEBUG nova.service [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Creating RPC server for service compute {{(pid=74482) start /opt/stack/nova/nova/service.py:182}}
Oct 23 22:55:07 user nova-compute[74482]: DEBUG nova.service [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] Join ServiceGroup membership for this service compute {{(pid=74482) start /opt/stack/nova/nova/service.py:199}}
Oct 23 22:55:07 user nova-compute[74482]: DEBUG nova.servicegroup.drivers.db [None req-e793cb61-8e76-46b8-9655-611a996aa4e6 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74482) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 23 22:55:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_power_states {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:55:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:55:58 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:55:58 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:55:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=10376MB free_disk=25.965740203857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:55:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:55:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:55:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:55:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:55:58 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:55:58 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:55:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:55:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:56:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:56:59 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:56:59 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:56:59 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=10321MB free_disk=26.030353546142578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:56:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:56:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:56:59 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:56:59 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:56:59 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:56:59 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:56:59 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:56:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:57:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:57:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:57:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:57:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:57:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 22:57:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:57:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:57:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:57:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:57:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:57:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:57:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:57:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:57:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:58:00 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:58:01 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:58:01 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:58:01 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=10297MB free_disk=25.78342056274414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:58:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:58:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:58:01 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:58:01 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:58:01 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:58:01 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:58:01 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:58:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:58:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:58:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:58:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:58:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:59:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:59:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 22:59:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:59:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:59:03 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:03 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:03 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9570MB free_disk=25.803192138671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:59:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:03 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:59:03 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:59:03 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:03 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:03 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:59:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "fc2566c6-8911-425b-b05d-a008e67a9d34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:59:11 user nova-compute[74482]: INFO nova.compute.claims [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Claim successful on node user
Oct 23 22:59:11 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:59:11 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:59:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:59:11 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Creating image(s)
Oct 23 22:59:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "/opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "/opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG nova.policy [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebd17d342e7145e0bad04188ec8be780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981f084ec65e4fa0a9cbd2e5edf8302a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:59:12 user nova-compute[74482]: INFO nova.compute.claims [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Claim successful on node user
Oct 23 22:59:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae.part --force-share --output=json" returned: 0 in 0.240s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG nova.virt.images [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] 8269c4ae-64d4-478e-8976-b601953bda88 was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 22:59:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae.part /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae.part /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae.converted" returned: 0 in 0.220s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae.converted --force-share --output=json" returned: 0 in 0.244s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.348s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:13 user nova-compute[74482]: INFO oslo.privsep.daemon [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsex7ad7l/privsep.sock']
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:59:13 user nova-compute[74482]: INFO nova.compute.claims [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Claim successful on node user
Oct 23 22:59:13 user sudo[83971]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsex7ad7l/privsep.sock
Oct 23 22:59:13 user sudo[83971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:59:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.policy [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ad45a40b18f4217924249b71fd4c93d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69039bafbadf4db8862003e2483fc973', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Successfully created port: fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:59:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Creating image(s)
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "/opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "/opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "95802cf3-56ba-4224-a333-e00e54c72166" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.446s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:13 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:59:13 user nova-compute[74482]: INFO nova.compute.claims [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Claim successful on node user
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.network.neutron [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:59:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Creating image(s)
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.352s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:59:14 user nova-compute[74482]: INFO nova.compute.claims [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Claim successful on node user
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.policy [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db64843c4a004d9fa23a275e43922494', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90728bc29a340049b8e038931eaf396', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:59:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:59:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Creating image(s)
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.policy [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dfe9260c1b8446fbcda07a9dcfa65fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07328e2befa472d804361a59ac16829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.network.neutron [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:59:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:59:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:59:15 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Creating image(s)
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:59:15 user nova-compute[74482]: INFO nova.compute.claims [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Claim successful on node user
Oct 23 22:59:15 user sudo[83971]: pam_unix(sudo:session): session closed for user root
Oct 23 22:59:15 user nova-compute[74482]: INFO oslo.privsep.daemon [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Spawned new privsep daemon via rootwrap
Oct 23 22:59:15 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 22:59:15 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 22:59:15 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 23 22:59:15 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83974
Oct 23 22:59:15 user nova-compute[74482]: WARNING oslo_privsep.priv_context [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] privsep daemon already running
Oct 23 22:59:15 user nova-compute[74482]: WARNING oslo_privsep.priv_context [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] privsep daemon already running
Oct 23 22:59:15 user nova-compute[74482]: WARNING oslo_privsep.priv_context [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] privsep daemon already running
Oct 23 22:59:15 user nova-compute[74482]: WARNING oslo_privsep.priv_context [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] privsep daemon already running
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.policy [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dfe9260c1b8446fbcda07a9dcfa65fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07328e2befa472d804361a59ac16829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Successfully updated port: fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.214s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.257s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.233s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquired lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.218s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-a8275906-bd17-44b5-8070-1b404b921811 req-beea8b26-d53e-433d-be80-256abd2cac97 service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received event network-changed-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-a8275906-bd17-44b5-8070-1b404b921811 req-beea8b26-d53e-433d-be80-256abd2cac97 service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Refreshing instance network info cache due to event network-changed-fc58ce30-d69f-4b68-af4b-d9a687840887. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a8275906-bd17-44b5-8070-1b404b921811 req-beea8b26-d53e-433d-be80-256abd2cac97 service nova] Acquiring lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.240s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk 1073741824" returned: 0 in 0.058s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.263s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:59:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:59:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.228s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.254s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.policy [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6e62933fe47479baf3029e44d3b8759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7418b41ef984478daf12ce3a2c72c3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk 1073741824" returned: 0 in 0.069s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.647s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:59:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Creating image(s)
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "/opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "/opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Cannot resize image /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.208s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Successfully created port: 26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk 1073741824" returned: 0 in 0.047s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.939s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Cannot resize image /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Ensure instance console log exists: /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.160s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk 1073741824" returned: 0 in 0.064s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 1.188s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Cannot resize image /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Ensure instance console log exists: /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updating instance_info_cache with network_info: [{"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Releasing lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Instance network_info: |[{"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a8275906-bd17-44b5-8070-1b404b921811 req-beea8b26-d53e-433d-be80-256abd2cac97 service nova] Acquired lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.network.neutron [req-a8275906-bd17-44b5-8070-1b404b921811 req-beea8b26-d53e-433d-be80-256abd2cac97 service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Refreshing network info cache for port fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Start _get_guest_xml network_info=[{"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:59:17 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:17 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2108851944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2108851944',id=1,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-4pygvrqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:12Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=fc2566c6-8911-425b-b05d-a008e67a9d34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:86:7f,bridge_name='br-int',has_traffic_filtering=True,id=fc58ce30-d69f-4b68-af4b-d9a687840887,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc58ce30-d6') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2566c6-8911-425b-b05d-a008e67a9d34 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.236s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:59:17 user nova-compute[74482]:   <uuid>fc2566c6-8911-425b-b05d-a008e67a9d34</uuid>
Oct 23 22:59:17 user nova-compute[74482]:   <name>instance-00000001</name>
Oct 23 22:59:17 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 22:59:17 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 22:59:17 user nova-compute[74482]:   <metadata>
Oct 23 22:59:17 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:59:17 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 22:59:17 user nova-compute[74482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2108851944</nova:name>
Oct 23 22:59:17 user nova-compute[74482]:       <nova:creationTime>2023-10-23 22:59:17</nova:creationTime>
Oct 23 22:59:17 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 22:59:17 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 22:59:17 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 22:59:17 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 22:59:17 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:59:17 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:59:17 user nova-compute[74482]:       </nova:flavor>
Oct 23 22:59:17 user nova-compute[74482]:       <nova:owner>
Oct 23 22:59:17 user nova-compute[74482]:         <nova:user uuid="ebd17d342e7145e0bad04188ec8be780">tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member</nova:user>
Oct 23 22:59:17 user nova-compute[74482]:         <nova:project uuid="981f084ec65e4fa0a9cbd2e5edf8302a">tempest-ServerBootFromVolumeStableRescueTest-157113739</nova:project>
Oct 23 22:59:17 user nova-compute[74482]:       </nova:owner>
Oct 23 22:59:17 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 22:59:17 user nova-compute[74482]:       <nova:ports>
Oct 23 22:59:17 user nova-compute[74482]:         <nova:port uuid="fc58ce30-d69f-4b68-af4b-d9a687840887">
Oct 23 22:59:17 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 22:59:17 user nova-compute[74482]:         </nova:port>
Oct 23 22:59:17 user nova-compute[74482]:       </nova:ports>
Oct 23 22:59:17 user nova-compute[74482]:     </nova:instance>
Oct 23 22:59:17 user nova-compute[74482]:   </metadata>
Oct 23 22:59:17 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 22:59:17 user nova-compute[74482]:     <system>
Oct 23 22:59:17 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:59:17 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:59:17 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 22:59:17 user nova-compute[74482]:       <entry name="serial">fc2566c6-8911-425b-b05d-a008e67a9d34</entry>
Oct 23 22:59:17 user nova-compute[74482]:       <entry name="uuid">fc2566c6-8911-425b-b05d-a008e67a9d34</entry>
Oct 23 22:59:17 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:59:17 user nova-compute[74482]:     </system>
Oct 23 22:59:17 user nova-compute[74482]:   </sysinfo>
Oct 23 22:59:17 user nova-compute[74482]:   <os>
Oct 23 22:59:17 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:59:17 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 22:59:17 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 22:59:17 user nova-compute[74482]:   </os>
Oct 23 22:59:17 user nova-compute[74482]:   <features>
Oct 23 22:59:17 user nova-compute[74482]:     <acpi/>
Oct 23 22:59:17 user nova-compute[74482]:     <apic/>
Oct 23 22:59:17 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 22:59:17 user nova-compute[74482]:   </features>
Oct 23 22:59:17 user nova-compute[74482]:   <clock offset="utc">
Oct 23 22:59:17 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:59:17 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:59:17 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 22:59:17 user nova-compute[74482]:   </clock>
Oct 23 22:59:17 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 22:59:17 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 22:59:17 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:59:17 user nova-compute[74482]:   </cpu>
Oct 23 22:59:17 user nova-compute[74482]:   <devices>
Oct 23 22:59:17 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 22:59:17 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:59:17 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk"/>
Oct 23 22:59:17 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 22:59:17 user nova-compute[74482]:     </disk>
Oct 23 22:59:17 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 22:59:17 user nova-compute[74482]:       <mac address="fa:16:3e:db:86:7f"/>
Oct 23 22:59:17 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:17 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 22:59:17 user nova-compute[74482]:       <target dev="tapfc58ce30-d6"/>
Oct 23 22:59:17 user nova-compute[74482]:     </interface>
Oct 23 22:59:17 user nova-compute[74482]:     <serial type="pty">
Oct 23 22:59:17 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/console.log" append="off"/>
Oct 23 22:59:17 user nova-compute[74482]:     </serial>
Oct 23 22:59:17 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:59:17 user nova-compute[74482]:     <video>
Oct 23 22:59:17 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:17 user nova-compute[74482]:     </video>
Oct 23 22:59:17 user nova-compute[74482]:     <rng model="virtio">
Oct 23 22:59:17 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:59:17 user nova-compute[74482]:     </rng>
Oct 23 22:59:17 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:59:17 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 22:59:17 user nova-compute[74482]:       <stats period="10"/>
Oct 23 22:59:17 user nova-compute[74482]:     </memballoon>
Oct 23 22:59:17 user nova-compute[74482]:   </devices>
Oct 23 22:59:17 user nova-compute[74482]: </domain>
Oct 23 22:59:17 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2108851944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2108851944',id=1,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-4pygvrqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:12Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=fc2566c6-8911-425b-b05d-a008e67a9d34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:86:7f,bridge_name='br-int',has_traffic_filtering=True,id=fc58ce30-d69f-4b68-af4b-d9a687840887,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc58ce30-d6') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG os_vif [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:86:7f,bridge_name='br-int',has_traffic_filtering=True,id=fc58ce30-d69f-4b68-af4b-d9a687840887,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc58ce30-d6') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.310s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Successfully created port: dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Created schema index Interface.name {{(pid=74482) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Created schema index Port.name {{(pid=74482) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Created schema index Bridge.name {{(pid=74482) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [POLLOUT] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk 1073741824" returned: 0 in 0.095s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Cannot resize image /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Ensure instance console log exists: /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.421s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.795s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Successfully created port: d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86d7c7a6-9a17-5f45-a71f-9b05fc8c2084', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Successfully created port: 26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:17 user nova-compute[74482]: INFO oslo.privsep.daemon [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp4n8zrqeg/privsep.sock']
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:17 user sudo[84060]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp4n8zrqeg/privsep.sock
Oct 23 22:59:17 user sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk 1073741824" returned: 0 in 0.052s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Cannot resize image /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Ensure instance console log exists: /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:59:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Cannot resize image /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Ensure instance console log exists: /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Successfully created port: c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG nova.network.neutron [req-a8275906-bd17-44b5-8070-1b404b921811 req-beea8b26-d53e-433d-be80-256abd2cac97 service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updated VIF entry in instance network info cache for port fc58ce30-d69f-4b68-af4b-d9a687840887. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG nova.network.neutron [req-a8275906-bd17-44b5-8070-1b404b921811 req-beea8b26-d53e-433d-be80-256abd2cac97 service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updating instance_info_cache with network_info: [{"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a8275906-bd17-44b5-8070-1b404b921811 req-beea8b26-d53e-433d-be80-256abd2cac97 service nova] Releasing lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:19 user sudo[84060]: pam_unix(sudo:session): session closed for user root
Oct 23 22:59:19 user nova-compute[74482]: INFO oslo.privsep.daemon [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Spawned new privsep daemon via rootwrap
Oct 23 22:59:19 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 22:59:19 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 22:59:19 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 23 22:59:19 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84076
Oct 23 22:59:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Successfully updated port: 26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquired lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc58ce30-d6, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc58ce30-d6, col_values=(('qos', UUID('daa7eede-eaaf-4949-bf61-cb1fc527abe3')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc58ce30-d6, col_values=(('external_ids', {'iface-id': 'fc58ce30-d69f-4b68-af4b-d9a687840887', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:86:7f', 'vm-uuid': 'fc2566c6-8911-425b-b05d-a008e67a9d34'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:19 user nova-compute[74482]: INFO os_vif [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:86:7f,bridge_name='br-int',has_traffic_filtering=True,id=fc58ce30-d69f-4b68-af4b-d9a687840887,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc58ce30-d6')
Oct 23 22:59:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No VIF found with MAC fa:16:3e:db:86:7f, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG nova.compute.manager [req-92403c3f-205e-4b44-ab64-7df4c26a6f40 req-8b2fc1b3-7051-4e09-84a6-f9df40698fb4 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-changed-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG nova.compute.manager [req-92403c3f-205e-4b44-ab64-7df4c26a6f40 req-8b2fc1b3-7051-4e09-84a6-f9df40698fb4 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Refreshing instance network info cache due to event network-changed-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-92403c3f-205e-4b44-ab64-7df4c26a6f40 req-8b2fc1b3-7051-4e09-84a6-f9df40698fb4 service nova] Acquiring lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Successfully updated port: 26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquired lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Successfully updated port: dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-cd47b38a-6968-4f52-830c-79de3ac1aa71 req-205accb8-17ca-422a-9adc-eab5d375778e service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-changed-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-cd47b38a-6968-4f52-830c-79de3ac1aa71 req-205accb8-17ca-422a-9adc-eab5d375778e service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Refreshing instance network info cache due to event network-changed-26004c78-273a-4649-818c-2cd38fd8bcbc. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cd47b38a-6968-4f52-830c-79de3ac1aa71 req-205accb8-17ca-422a-9adc-eab5d375778e service nova] Acquiring lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquired lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance_info_cache with network_info: [{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Releasing lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance network_info: |[{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-92403c3f-205e-4b44-ab64-7df4c26a6f40 req-8b2fc1b3-7051-4e09-84a6-f9df40698fb4 service nova] Acquired lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-92403c3f-205e-4b44-ab64-7df4c26a6f40 req-8b2fc1b3-7051-4e09-84a6-f9df40698fb4 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Refreshing network info cache for port 26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Start _get_guest_xml network_info=[{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:59:20 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:20 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1895303322',display_name='tempest-ServerActionsTestOtherB-server-1895303322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1895303322',id=2,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtTCYnjLWuZ5ND071jtsoNL+jCbUBIt9fx3Xpn4EVHhYK3Fa774GNC5Gw1NBdqzVTnVApUJDfyn5fEVDoKQTbN3TLPt6wiaiOSOkoESIbi/mWxf/f66vq9c/4Twd5CY7Q==',key_name='tempest-keypair-2026660343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69039bafbadf4db8862003e2483fc973',ramdisk_id='',reservation_id='r-ejmhk03v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-598393554',owner_user_name='tempest-ServerActionsTestOtherB-598393554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad45a40b18f4217924249b71fd4c93d',uuid=aa063829-b117-40f4-93f2-358b33f1d156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converting VIF {"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lazy-loading 'pci_devices' on Instance uuid aa063829-b117-40f4-93f2-358b33f1d156 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:59:20 user nova-compute[74482]:   <uuid>aa063829-b117-40f4-93f2-358b33f1d156</uuid>
Oct 23 22:59:20 user nova-compute[74482]:   <name>instance-00000002</name>
Oct 23 22:59:20 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 22:59:20 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 22:59:20 user nova-compute[74482]:   <metadata>
Oct 23 22:59:20 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:59:20 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 22:59:20 user nova-compute[74482]:       <nova:name>tempest-ServerActionsTestOtherB-server-1895303322</nova:name>
Oct 23 22:59:20 user nova-compute[74482]:       <nova:creationTime>2023-10-23 22:59:20</nova:creationTime>
Oct 23 22:59:20 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 22:59:20 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 22:59:20 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 22:59:20 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 22:59:20 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:59:20 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:59:20 user nova-compute[74482]:       </nova:flavor>
Oct 23 22:59:20 user nova-compute[74482]:       <nova:owner>
Oct 23 22:59:20 user nova-compute[74482]:         <nova:user uuid="8ad45a40b18f4217924249b71fd4c93d">tempest-ServerActionsTestOtherB-598393554-project-member</nova:user>
Oct 23 22:59:20 user nova-compute[74482]:         <nova:project uuid="69039bafbadf4db8862003e2483fc973">tempest-ServerActionsTestOtherB-598393554</nova:project>
Oct 23 22:59:20 user nova-compute[74482]:       </nova:owner>
Oct 23 22:59:20 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 22:59:20 user nova-compute[74482]:       <nova:ports>
Oct 23 22:59:20 user nova-compute[74482]:         <nova:port uuid="26dfbe86-3706-4d55-8a27-3e7d97ffbaa3">
Oct 23 22:59:20 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 22:59:20 user nova-compute[74482]:         </nova:port>
Oct 23 22:59:20 user nova-compute[74482]:       </nova:ports>
Oct 23 22:59:20 user nova-compute[74482]:     </nova:instance>
Oct 23 22:59:20 user nova-compute[74482]:   </metadata>
Oct 23 22:59:20 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 22:59:20 user nova-compute[74482]:     <system>
Oct 23 22:59:20 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:59:20 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:59:20 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 22:59:20 user nova-compute[74482]:       <entry name="serial">aa063829-b117-40f4-93f2-358b33f1d156</entry>
Oct 23 22:59:20 user nova-compute[74482]:       <entry name="uuid">aa063829-b117-40f4-93f2-358b33f1d156</entry>
Oct 23 22:59:20 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:59:20 user nova-compute[74482]:     </system>
Oct 23 22:59:20 user nova-compute[74482]:   </sysinfo>
Oct 23 22:59:20 user nova-compute[74482]:   <os>
Oct 23 22:59:20 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:59:20 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 22:59:20 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 22:59:20 user nova-compute[74482]:   </os>
Oct 23 22:59:20 user nova-compute[74482]:   <features>
Oct 23 22:59:20 user nova-compute[74482]:     <acpi/>
Oct 23 22:59:20 user nova-compute[74482]:     <apic/>
Oct 23 22:59:20 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 22:59:20 user nova-compute[74482]:   </features>
Oct 23 22:59:20 user nova-compute[74482]:   <clock offset="utc">
Oct 23 22:59:20 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:59:20 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:59:20 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 22:59:20 user nova-compute[74482]:   </clock>
Oct 23 22:59:20 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 22:59:20 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 22:59:20 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:59:20 user nova-compute[74482]:   </cpu>
Oct 23 22:59:20 user nova-compute[74482]:   <devices>
Oct 23 22:59:20 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 22:59:20 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:59:20 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk"/>
Oct 23 22:59:20 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 22:59:20 user nova-compute[74482]:     </disk>
Oct 23 22:59:20 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 22:59:20 user nova-compute[74482]:       <mac address="fa:16:3e:5f:07:d9"/>
Oct 23 22:59:20 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:20 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 22:59:20 user nova-compute[74482]:       <target dev="tap26dfbe86-37"/>
Oct 23 22:59:20 user nova-compute[74482]:     </interface>
Oct 23 22:59:20 user nova-compute[74482]:     <serial type="pty">
Oct 23 22:59:20 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/console.log" append="off"/>
Oct 23 22:59:20 user nova-compute[74482]:     </serial>
Oct 23 22:59:20 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:59:20 user nova-compute[74482]:     <video>
Oct 23 22:59:20 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:20 user nova-compute[74482]:     </video>
Oct 23 22:59:20 user nova-compute[74482]:     <rng model="virtio">
Oct 23 22:59:20 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:59:20 user nova-compute[74482]:     </rng>
Oct 23 22:59:20 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:59:20 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 22:59:20 user nova-compute[74482]:       <stats period="10"/>
Oct 23 22:59:20 user nova-compute[74482]:     </memballoon>
Oct 23 22:59:20 user nova-compute[74482]:   </devices>
Oct 23 22:59:20 user nova-compute[74482]: </domain>
Oct 23 22:59:20 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1895303322',display_name='tempest-ServerActionsTestOtherB-server-1895303322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1895303322',id=2,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtTCYnjLWuZ5ND071jtsoNL+jCbUBIt9fx3Xpn4EVHhYK3Fa774GNC5Gw1NBdqzVTnVApUJDfyn5fEVDoKQTbN3TLPt6wiaiOSOkoESIbi/mWxf/f66vq9c/4Twd5CY7Q==',key_name='tempest-keypair-2026660343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69039bafbadf4db8862003e2483fc973',ramdisk_id='',reservation_id='r-ejmhk03v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-598393554',owner_user_name='tempest-ServerActionsTestOtherB-598393554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad45a40b18f4217924249b71fd4c93d',uuid=aa063829-b117-40f4-93f2-358b33f1d156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converting VIF {"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG os_vif [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '555976a0-e423-5268-b7e5-36fd51a4a60e', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26dfbe86-37, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26dfbe86-37, col_values=(('qos', UUID('a53e3223-b212-4cfc-84d7-dde7a6d0a4c7')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26dfbe86-37, col_values=(('external_ids', {'iface-id': '26dfbe86-3706-4d55-8a27-3e7d97ffbaa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:07:d9', 'vm-uuid': 'aa063829-b117-40f4-93f2-358b33f1d156'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:20 user nova-compute[74482]: INFO os_vif [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37')
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Successfully updated port: d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquired lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] No VIF found with MAC fa:16:3e:5f:07:d9, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updating instance_info_cache with network_info: [{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Releasing lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Instance network_info: |[{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cd47b38a-6968-4f52-830c-79de3ac1aa71 req-205accb8-17ca-422a-9adc-eab5d375778e service nova] Acquired lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.network.neutron [req-cd47b38a-6968-4f52-830c-79de3ac1aa71 req-205accb8-17ca-422a-9adc-eab5d375778e service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Refreshing network info cache for port 26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Start _get_guest_xml network_info=[{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:59:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-906590860',display_name='tempest-ServerRescueNegativeTestJSON-server-906590860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-906590860',id=4,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-q5yfdo5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:15Z,user_data=None,user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=2c51493a-92fc-4297-9ba9-8ee2770c8eb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ee:5b,bridge_name='br-int',has_traffic_filtering=True,id=26004c78-273a-4649-818c-2cd38fd8bcbc,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26004c78-27') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:59:21 user nova-compute[74482]:   <uuid>2c51493a-92fc-4297-9ba9-8ee2770c8eb0</uuid>
Oct 23 22:59:21 user nova-compute[74482]:   <name>instance-00000004</name>
Oct 23 22:59:21 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 22:59:21 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 22:59:21 user nova-compute[74482]:   <metadata>
Oct 23 22:59:21 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:59:21 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 22:59:21 user nova-compute[74482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-906590860</nova:name>
Oct 23 22:59:21 user nova-compute[74482]:       <nova:creationTime>2023-10-23 22:59:21</nova:creationTime>
Oct 23 22:59:21 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 22:59:21 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 22:59:21 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 22:59:21 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 22:59:21 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:59:21 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:59:21 user nova-compute[74482]:       </nova:flavor>
Oct 23 22:59:21 user nova-compute[74482]:       <nova:owner>
Oct 23 22:59:21 user nova-compute[74482]:         <nova:user uuid="2dfe9260c1b8446fbcda07a9dcfa65fb">tempest-ServerRescueNegativeTestJSON-1888569284-project-member</nova:user>
Oct 23 22:59:21 user nova-compute[74482]:         <nova:project uuid="c07328e2befa472d804361a59ac16829">tempest-ServerRescueNegativeTestJSON-1888569284</nova:project>
Oct 23 22:59:21 user nova-compute[74482]:       </nova:owner>
Oct 23 22:59:21 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 22:59:21 user nova-compute[74482]:       <nova:ports>
Oct 23 22:59:21 user nova-compute[74482]:         <nova:port uuid="26004c78-273a-4649-818c-2cd38fd8bcbc">
Oct 23 22:59:21 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 22:59:21 user nova-compute[74482]:         </nova:port>
Oct 23 22:59:21 user nova-compute[74482]:       </nova:ports>
Oct 23 22:59:21 user nova-compute[74482]:     </nova:instance>
Oct 23 22:59:21 user nova-compute[74482]:   </metadata>
Oct 23 22:59:21 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 22:59:21 user nova-compute[74482]:     <system>
Oct 23 22:59:21 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:59:21 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:59:21 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 22:59:21 user nova-compute[74482]:       <entry name="serial">2c51493a-92fc-4297-9ba9-8ee2770c8eb0</entry>
Oct 23 22:59:21 user nova-compute[74482]:       <entry name="uuid">2c51493a-92fc-4297-9ba9-8ee2770c8eb0</entry>
Oct 23 22:59:21 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:59:21 user nova-compute[74482]:     </system>
Oct 23 22:59:21 user nova-compute[74482]:   </sysinfo>
Oct 23 22:59:21 user nova-compute[74482]:   <os>
Oct 23 22:59:21 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:59:21 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 22:59:21 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 22:59:21 user nova-compute[74482]:   </os>
Oct 23 22:59:21 user nova-compute[74482]:   <features>
Oct 23 22:59:21 user nova-compute[74482]:     <acpi/>
Oct 23 22:59:21 user nova-compute[74482]:     <apic/>
Oct 23 22:59:21 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 22:59:21 user nova-compute[74482]:   </features>
Oct 23 22:59:21 user nova-compute[74482]:   <clock offset="utc">
Oct 23 22:59:21 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:59:21 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:59:21 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 22:59:21 user nova-compute[74482]:   </clock>
Oct 23 22:59:21 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 22:59:21 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 22:59:21 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:59:21 user nova-compute[74482]:   </cpu>
Oct 23 22:59:21 user nova-compute[74482]:   <devices>
Oct 23 22:59:21 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 22:59:21 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:59:21 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk"/>
Oct 23 22:59:21 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 22:59:21 user nova-compute[74482]:     </disk>
Oct 23 22:59:21 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 22:59:21 user nova-compute[74482]:       <mac address="fa:16:3e:08:ee:5b"/>
Oct 23 22:59:21 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:21 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 22:59:21 user nova-compute[74482]:       <target dev="tap26004c78-27"/>
Oct 23 22:59:21 user nova-compute[74482]:     </interface>
Oct 23 22:59:21 user nova-compute[74482]:     <serial type="pty">
Oct 23 22:59:21 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/console.log" append="off"/>
Oct 23 22:59:21 user nova-compute[74482]:     </serial>
Oct 23 22:59:21 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:59:21 user nova-compute[74482]:     <video>
Oct 23 22:59:21 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:21 user nova-compute[74482]:     </video>
Oct 23 22:59:21 user nova-compute[74482]:     <rng model="virtio">
Oct 23 22:59:21 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:59:21 user nova-compute[74482]:     </rng>
Oct 23 22:59:21 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:59:21 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 22:59:21 user nova-compute[74482]:       <stats period="10"/>
Oct 23 22:59:21 user nova-compute[74482]:     </memballoon>
Oct 23 22:59:21 user nova-compute[74482]:   </devices>
Oct 23 22:59:21 user nova-compute[74482]: </domain>
Oct 23 22:59:21 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-906590860',display_name='tempest-ServerRescueNegativeTestJSON-server-906590860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-906590860',id=4,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-q5yfdo5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:15Z,user_data=None,user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=2c51493a-92fc-4297-9ba9-8ee2770c8eb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:ee:5b,bridge_name='br-int',has_traffic_filtering=True,id=26004c78-273a-4649-818c-2cd38fd8bcbc,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26004c78-27') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG os_vif [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ee:5b,bridge_name='br-int',has_traffic_filtering=True,id=26004c78-273a-4649-818c-2cd38fd8bcbc,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26004c78-27') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02d08c82-f96e-56bd-9ff6-bee93d49fa49', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26004c78-27, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26004c78-27, col_values=(('qos', UUID('8fd99231-5ac3-4ea9-94c5-961594512f5c')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26004c78-27, col_values=(('external_ids', {'iface-id': '26004c78-273a-4649-818c-2cd38fd8bcbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:ee:5b', 'vm-uuid': '2c51493a-92fc-4297-9ba9-8ee2770c8eb0'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:21 user nova-compute[74482]: INFO os_vif [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:ee:5b,bridge_name='br-int',has_traffic_filtering=True,id=26004c78-273a-4649-818c-2cd38fd8bcbc,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26004c78-27')
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Successfully updated port: c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquired lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-0a7e80a4-637d-47e5-9c15-5bac9263823c req-226377ff-0391-4047-9255-18a597e7577d service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received event network-changed-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-0a7e80a4-637d-47e5-9c15-5bac9263823c req-226377ff-0391-4047-9255-18a597e7577d service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Refreshing instance network info cache due to event network-changed-c4bb13fd-216f-4510-91df-11b772b3b71e. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0a7e80a4-637d-47e5-9c15-5bac9263823c req-226377ff-0391-4047-9255-18a597e7577d service nova] Acquiring lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No VIF found with MAC fa:16:3e:08:ee:5b, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating instance_info_cache with network_info: [{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-changed-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Refreshing instance network info cache due to event network-changed-dddb3b05-0e78-459a-ae09-5db2fd55bf4c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] Acquiring lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Releasing lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Instance network_info: |[{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] Acquired lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Refreshing network info cache for port dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Start _get_guest_xml network_info=[{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:59:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-467597565',display_name='tempest-ServerStableDeviceRescueTest-server-467597565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-467597565',id=3,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN59euXmu5u93kXefDnMv2OWRO6hScJjvsthZe+h3yZFekwDxAtA8t7r2Cpcir9cWcpIHxhd6PIwBFk80q1czIYaN1y5u1RJOSWA5KTi76auv9na1jCQ2R/sTX0O0bDjrw==',key_name='tempest-keypair-2115897655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d90728bc29a340049b8e038931eaf396',ramdisk_id='',reservation_id='r-19qetahm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1776446221',owner_user_name='tempest-ServerStableDeviceRescueTest-1776446221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db64843c4a004d9fa23a275e43922494',uuid=21d87eb6-effc-4d4f-9f31-80b8d2e15d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Converting VIF {"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:68:bb,bridge_name='br-int',has_traffic_filtering=True,id=dddb3b05-0e78-459a-ae09-5db2fd55bf4c,network=Network(19346391-44d4-4db1-88f0-6561dc27559e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddb3b05-0e') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.objects.instance [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'pci_devices' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:59:22 user nova-compute[74482]:   <uuid>21d87eb6-effc-4d4f-9f31-80b8d2e15d2d</uuid>
Oct 23 22:59:22 user nova-compute[74482]:   <name>instance-00000003</name>
Oct 23 22:59:22 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 22:59:22 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 22:59:22 user nova-compute[74482]:   <metadata>
Oct 23 22:59:22 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:59:22 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-467597565</nova:name>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:creationTime>2023-10-23 22:59:22</nova:creationTime>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 22:59:22 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:59:22 user nova-compute[74482]:       </nova:flavor>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:owner>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:user uuid="db64843c4a004d9fa23a275e43922494">tempest-ServerStableDeviceRescueTest-1776446221-project-member</nova:user>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:project uuid="d90728bc29a340049b8e038931eaf396">tempest-ServerStableDeviceRescueTest-1776446221</nova:project>
Oct 23 22:59:22 user nova-compute[74482]:       </nova:owner>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:ports>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:port uuid="dddb3b05-0e78-459a-ae09-5db2fd55bf4c">
Oct 23 22:59:22 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 22:59:22 user nova-compute[74482]:         </nova:port>
Oct 23 22:59:22 user nova-compute[74482]:       </nova:ports>
Oct 23 22:59:22 user nova-compute[74482]:     </nova:instance>
Oct 23 22:59:22 user nova-compute[74482]:   </metadata>
Oct 23 22:59:22 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 22:59:22 user nova-compute[74482]:     <system>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="serial">21d87eb6-effc-4d4f-9f31-80b8d2e15d2d</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="uuid">21d87eb6-effc-4d4f-9f31-80b8d2e15d2d</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:59:22 user nova-compute[74482]:     </system>
Oct 23 22:59:22 user nova-compute[74482]:   </sysinfo>
Oct 23 22:59:22 user nova-compute[74482]:   <os>
Oct 23 22:59:22 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:59:22 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 22:59:22 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 22:59:22 user nova-compute[74482]:   </os>
Oct 23 22:59:22 user nova-compute[74482]:   <features>
Oct 23 22:59:22 user nova-compute[74482]:     <acpi/>
Oct 23 22:59:22 user nova-compute[74482]:     <apic/>
Oct 23 22:59:22 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 22:59:22 user nova-compute[74482]:   </features>
Oct 23 22:59:22 user nova-compute[74482]:   <clock offset="utc">
Oct 23 22:59:22 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:59:22 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:59:22 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 22:59:22 user nova-compute[74482]:   </clock>
Oct 23 22:59:22 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 22:59:22 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 22:59:22 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:59:22 user nova-compute[74482]:   </cpu>
Oct 23 22:59:22 user nova-compute[74482]:   <devices>
Oct 23 22:59:22 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 22:59:22 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:59:22 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk"/>
Oct 23 22:59:22 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 22:59:22 user nova-compute[74482]:     </disk>
Oct 23 22:59:22 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 22:59:22 user nova-compute[74482]:       <mac address="fa:16:3e:f3:68:bb"/>
Oct 23 22:59:22 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:22 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 22:59:22 user nova-compute[74482]:       <target dev="tapdddb3b05-0e"/>
Oct 23 22:59:22 user nova-compute[74482]:     </interface>
Oct 23 22:59:22 user nova-compute[74482]:     <serial type="pty">
Oct 23 22:59:22 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/console.log" append="off"/>
Oct 23 22:59:22 user nova-compute[74482]:     </serial>
Oct 23 22:59:22 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:59:22 user nova-compute[74482]:     <video>
Oct 23 22:59:22 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:22 user nova-compute[74482]:     </video>
Oct 23 22:59:22 user nova-compute[74482]:     <rng model="virtio">
Oct 23 22:59:22 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:59:22 user nova-compute[74482]:     </rng>
Oct 23 22:59:22 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:59:22 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 22:59:22 user nova-compute[74482]:       <stats period="10"/>
Oct 23 22:59:22 user nova-compute[74482]:     </memballoon>
Oct 23 22:59:22 user nova-compute[74482]:   </devices>
Oct 23 22:59:22 user nova-compute[74482]: </domain>
Oct 23 22:59:22 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-467597565',display_name='tempest-ServerStableDeviceRescueTest-server-467597565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-467597565',id=3,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN59euXmu5u93kXefDnMv2OWRO6hScJjvsthZe+h3yZFekwDxAtA8t7r2Cpcir9cWcpIHxhd6PIwBFk80q1czIYaN1y5u1RJOSWA5KTi76auv9na1jCQ2R/sTX0O0bDjrw==',key_name='tempest-keypair-2115897655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d90728bc29a340049b8e038931eaf396',ramdisk_id='',reservation_id='r-19qetahm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1776446221',owner_user_name='tempest-ServerStableDeviceRescueTest-1776446221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db64843c4a004d9fa23a275e43922494',uuid=21d87eb6-effc-4d4f-9f31-80b8d2e15d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Converting VIF {"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:68:bb,bridge_name='br-int',has_traffic_filtering=True,id=dddb3b05-0e78-459a-ae09-5db2fd55bf4c,network=Network(19346391-44d4-4db1-88f0-6561dc27559e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddb3b05-0e') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG os_vif [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:68:bb,bridge_name='br-int',has_traffic_filtering=True,id=dddb3b05-0e78-459a-ae09-5db2fd55bf4c,network=Network(19346391-44d4-4db1-88f0-6561dc27559e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddb3b05-0e') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83a7531d-6f64-5fee-9127-1c14213b6b79', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdddb3b05-0e, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdddb3b05-0e, col_values=(('qos', UUID('01d811ef-47be-4cfc-8b63-ba2628e02c8b')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdddb3b05-0e, col_values=(('external_ids', {'iface-id': 'dddb3b05-0e78-459a-ae09-5db2fd55bf4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:68:bb', 'vm-uuid': '21d87eb6-effc-4d4f-9f31-80b8d2e15d2d'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: INFO os_vif [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:68:bb,bridge_name='br-int',has_traffic_filtering=True,id=dddb3b05-0e78-459a-ae09-5db2fd55bf4c,network=Network(19346391-44d4-4db1-88f0-6561dc27559e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddb3b05-0e')
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] No VIF found with MAC fa:16:3e:f3:68:bb, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Updating instance_info_cache with network_info: [{"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Releasing lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Instance network_info: |[{"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Start _get_guest_xml network_info=[{"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:59:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-441054838',display_name='tempest-ServerRescueNegativeTestJSON-server-441054838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-441054838',id=5,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-u4d3wnl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:15Z,user_data=None,user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=95802cf3-56ba-4224-a333-e00e54c72166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:09:58,bridge_name='br-int',has_traffic_filtering=True,id=d778946c-6512-4fb7-a247-910aaf4a3ea4,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd778946c-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.objects.instance [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'pci_devices' on Instance uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-92403c3f-205e-4b44-ab64-7df4c26a6f40 req-8b2fc1b3-7051-4e09-84a6-f9df40698fb4 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updated VIF entry in instance network info cache for port 26dfbe86-3706-4d55-8a27-3e7d97ffbaa3. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-92403c3f-205e-4b44-ab64-7df4c26a6f40 req-8b2fc1b3-7051-4e09-84a6-f9df40698fb4 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance_info_cache with network_info: [{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:59:22 user nova-compute[74482]:   <uuid>95802cf3-56ba-4224-a333-e00e54c72166</uuid>
Oct 23 22:59:22 user nova-compute[74482]:   <name>instance-00000005</name>
Oct 23 22:59:22 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 22:59:22 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 22:59:22 user nova-compute[74482]:   <metadata>
Oct 23 22:59:22 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:59:22 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-441054838</nova:name>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:creationTime>2023-10-23 22:59:22</nova:creationTime>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 22:59:22 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:59:22 user nova-compute[74482]:       </nova:flavor>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:owner>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:user uuid="2dfe9260c1b8446fbcda07a9dcfa65fb">tempest-ServerRescueNegativeTestJSON-1888569284-project-member</nova:user>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:project uuid="c07328e2befa472d804361a59ac16829">tempest-ServerRescueNegativeTestJSON-1888569284</nova:project>
Oct 23 22:59:22 user nova-compute[74482]:       </nova:owner>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 22:59:22 user nova-compute[74482]:       <nova:ports>
Oct 23 22:59:22 user nova-compute[74482]:         <nova:port uuid="d778946c-6512-4fb7-a247-910aaf4a3ea4">
Oct 23 22:59:22 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 22:59:22 user nova-compute[74482]:         </nova:port>
Oct 23 22:59:22 user nova-compute[74482]:       </nova:ports>
Oct 23 22:59:22 user nova-compute[74482]:     </nova:instance>
Oct 23 22:59:22 user nova-compute[74482]:   </metadata>
Oct 23 22:59:22 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 22:59:22 user nova-compute[74482]:     <system>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="serial">95802cf3-56ba-4224-a333-e00e54c72166</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="uuid">95802cf3-56ba-4224-a333-e00e54c72166</entry>
Oct 23 22:59:22 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:59:22 user nova-compute[74482]:     </system>
Oct 23 22:59:22 user nova-compute[74482]:   </sysinfo>
Oct 23 22:59:22 user nova-compute[74482]:   <os>
Oct 23 22:59:22 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:59:22 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 22:59:22 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 22:59:22 user nova-compute[74482]:   </os>
Oct 23 22:59:22 user nova-compute[74482]:   <features>
Oct 23 22:59:22 user nova-compute[74482]:     <acpi/>
Oct 23 22:59:22 user nova-compute[74482]:     <apic/>
Oct 23 22:59:22 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 22:59:22 user nova-compute[74482]:   </features>
Oct 23 22:59:22 user nova-compute[74482]:   <clock offset="utc">
Oct 23 22:59:22 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:59:22 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:59:22 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 22:59:22 user nova-compute[74482]:   </clock>
Oct 23 22:59:22 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 22:59:22 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 22:59:22 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:59:22 user nova-compute[74482]:   </cpu>
Oct 23 22:59:22 user nova-compute[74482]:   <devices>
Oct 23 22:59:22 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 22:59:22 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:59:22 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk"/>
Oct 23 22:59:22 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 22:59:22 user nova-compute[74482]:     </disk>
Oct 23 22:59:22 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 22:59:22 user nova-compute[74482]:       <mac address="fa:16:3e:ec:09:58"/>
Oct 23 22:59:22 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:22 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 22:59:22 user nova-compute[74482]:       <target dev="tapd778946c-65"/>
Oct 23 22:59:22 user nova-compute[74482]:     </interface>
Oct 23 22:59:22 user nova-compute[74482]:     <serial type="pty">
Oct 23 22:59:22 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/console.log" append="off"/>
Oct 23 22:59:22 user nova-compute[74482]:     </serial>
Oct 23 22:59:22 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:59:22 user nova-compute[74482]:     <video>
Oct 23 22:59:22 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:22 user nova-compute[74482]:     </video>
Oct 23 22:59:22 user nova-compute[74482]:     <rng model="virtio">
Oct 23 22:59:22 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:59:22 user nova-compute[74482]:     </rng>
Oct 23 22:59:22 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:59:22 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 22:59:22 user nova-compute[74482]:       <stats period="10"/>
Oct 23 22:59:22 user nova-compute[74482]:     </memballoon>
Oct 23 22:59:22 user nova-compute[74482]:   </devices>
Oct 23 22:59:22 user nova-compute[74482]: </domain>
Oct 23 22:59:22 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-441054838',display_name='tempest-ServerRescueNegativeTestJSON-server-441054838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-441054838',id=5,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-u4d3wnl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:15Z,user_data=None,user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=95802cf3-56ba-4224-a333-e00e54c72166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:09:58,bridge_name='br-int',has_traffic_filtering=True,id=d778946c-6512-4fb7-a247-910aaf4a3ea4,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd778946c-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG os_vif [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:09:58,bridge_name='br-int',has_traffic_filtering=True,id=d778946c-6512-4fb7-a247-910aaf4a3ea4,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd778946c-65') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-92403c3f-205e-4b44-ab64-7df4c26a6f40 req-8b2fc1b3-7051-4e09-84a6-f9df40698fb4 service nova] Releasing lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c753ddef-2a4a-5d31-8f5d-81cc53cd605b', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd778946c-65, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd778946c-65, col_values=(('qos', UUID('afb90344-aa55-48fe-be59-025015b7ac8c')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd778946c-65, col_values=(('external_ids', {'iface-id': 'd778946c-6512-4fb7-a247-910aaf4a3ea4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:09:58', 'vm-uuid': '95802cf3-56ba-4224-a333-e00e54c72166'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:22 user nova-compute[74482]: INFO os_vif [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:09:58,bridge_name='br-int',has_traffic_filtering=True,id=d778946c-6512-4fb7-a247-910aaf4a3ea4,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd778946c-65')
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-cd47b38a-6968-4f52-830c-79de3ac1aa71 req-205accb8-17ca-422a-9adc-eab5d375778e service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updated VIF entry in instance network info cache for port 26004c78-273a-4649-818c-2cd38fd8bcbc. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-cd47b38a-6968-4f52-830c-79de3ac1aa71 req-205accb8-17ca-422a-9adc-eab5d375778e service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updating instance_info_cache with network_info: [{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cd47b38a-6968-4f52-830c-79de3ac1aa71 req-205accb8-17ca-422a-9adc-eab5d375778e service nova] Releasing lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No VIF found with MAC fa:16:3e:ec:09:58, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updated VIF entry in instance network info cache for port dddb3b05-0e78-459a-ae09-5db2fd55bf4c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating instance_info_cache with network_info: [{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] Releasing lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-changed-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Refreshing instance network info cache due to event network-changed-d778946c-6512-4fb7-a247-910aaf4a3ea4. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] Acquiring lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] Acquired lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Refreshing network info cache for port d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:59:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updating instance_info_cache with network_info: [{"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Releasing lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Instance network_info: |[{"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:59:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0a7e80a4-637d-47e5-9c15-5bac9263823c req-226377ff-0391-4047-9255-18a597e7577d service nova] Acquired lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-0a7e80a4-637d-47e5-9c15-5bac9263823c req-226377ff-0391-4047-9255-18a597e7577d service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Refreshing network info cache for port c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:59:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Start _get_guest_xml network_info=[{"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:59:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Updated VIF entry in instance network info cache for port d778946c-6512-4fb7-a247-910aaf4a3ea4. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:59:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Updating instance_info_cache with network_info: [{"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eaf20b9b-ab50-4eef-8c51-4e4809351d7d req-b7404934-6e60-4e25-994a-bd789ed94371 service nova] Releasing lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:25 user nova-compute[74482]: DEBUG nova.network.neutron [req-0a7e80a4-637d-47e5-9c15-5bac9263823c req-226377ff-0391-4047-9255-18a597e7577d service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updated VIF entry in instance network info cache for port c4bb13fd-216f-4510-91df-11b772b3b71e. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:59:25 user nova-compute[74482]: DEBUG nova.network.neutron [req-0a7e80a4-637d-47e5-9c15-5bac9263823c req-226377ff-0391-4047-9255-18a597e7577d service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updating instance_info_cache with network_info: [{"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0a7e80a4-637d-47e5-9c15-5bac9263823c req-226377ff-0391-4047-9255-18a597e7577d service nova] Releasing lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:59:26 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Instance spawned successfully.
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:59:26 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:26 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1882742069',display_name='tempest-ServerActionsTestOtherA-server-1882742069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1882742069',id=6,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIFqjOSyUZWQsU5gFsbXrBOoj4Cp26qpoZb6ZuADPp+mJaMBG92ILD46Qtgf0LpXdVLgOqmH/QEGrVpFM/l9sAP2h6k2MXu+chElwiN2sa7paHBVT+RCfDr3O/3kW7sqg==',key_name='tempest-keypair-1686845388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-wwjw0rob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=c7e4371a-32f9-4156-bea9-b7c4b5df3100,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0c:ce,bridge_name='br-int',has_traffic_filtering=True,id=c4bb13fd-216f-4510-91df-11b772b3b71e,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb13fd-21') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'pci_devices' on Instance uuid c7e4371a-32f9-4156-bea9-b7c4b5df3100 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:59:26 user nova-compute[74482]:   <uuid>c7e4371a-32f9-4156-bea9-b7c4b5df3100</uuid>
Oct 23 22:59:26 user nova-compute[74482]:   <name>instance-00000006</name>
Oct 23 22:59:26 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 22:59:26 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 22:59:26 user nova-compute[74482]:   <metadata>
Oct 23 22:59:26 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:59:26 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 22:59:26 user nova-compute[74482]:       <nova:name>tempest-ServerActionsTestOtherA-server-1882742069</nova:name>
Oct 23 22:59:26 user nova-compute[74482]:       <nova:creationTime>2023-10-23 22:59:26</nova:creationTime>
Oct 23 22:59:26 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 22:59:26 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 22:59:26 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 22:59:26 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 22:59:26 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:59:26 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:59:26 user nova-compute[74482]:       </nova:flavor>
Oct 23 22:59:26 user nova-compute[74482]:       <nova:owner>
Oct 23 22:59:26 user nova-compute[74482]:         <nova:user uuid="a6e62933fe47479baf3029e44d3b8759">tempest-ServerActionsTestOtherA-1928343369-project-member</nova:user>
Oct 23 22:59:26 user nova-compute[74482]:         <nova:project uuid="7418b41ef984478daf12ce3a2c72c3c6">tempest-ServerActionsTestOtherA-1928343369</nova:project>
Oct 23 22:59:26 user nova-compute[74482]:       </nova:owner>
Oct 23 22:59:26 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 22:59:26 user nova-compute[74482]:       <nova:ports>
Oct 23 22:59:26 user nova-compute[74482]:         <nova:port uuid="c4bb13fd-216f-4510-91df-11b772b3b71e">
Oct 23 22:59:26 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 22:59:26 user nova-compute[74482]:         </nova:port>
Oct 23 22:59:26 user nova-compute[74482]:       </nova:ports>
Oct 23 22:59:26 user nova-compute[74482]:     </nova:instance>
Oct 23 22:59:26 user nova-compute[74482]:   </metadata>
Oct 23 22:59:26 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 22:59:26 user nova-compute[74482]:     <system>
Oct 23 22:59:26 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:59:26 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:59:26 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 22:59:26 user nova-compute[74482]:       <entry name="serial">c7e4371a-32f9-4156-bea9-b7c4b5df3100</entry>
Oct 23 22:59:26 user nova-compute[74482]:       <entry name="uuid">c7e4371a-32f9-4156-bea9-b7c4b5df3100</entry>
Oct 23 22:59:26 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:59:26 user nova-compute[74482]:     </system>
Oct 23 22:59:26 user nova-compute[74482]:   </sysinfo>
Oct 23 22:59:26 user nova-compute[74482]:   <os>
Oct 23 22:59:26 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:59:26 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 22:59:26 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 22:59:26 user nova-compute[74482]:   </os>
Oct 23 22:59:26 user nova-compute[74482]:   <features>
Oct 23 22:59:26 user nova-compute[74482]:     <acpi/>
Oct 23 22:59:26 user nova-compute[74482]:     <apic/>
Oct 23 22:59:26 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 22:59:26 user nova-compute[74482]:   </features>
Oct 23 22:59:26 user nova-compute[74482]:   <clock offset="utc">
Oct 23 22:59:26 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:59:26 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:59:26 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 22:59:26 user nova-compute[74482]:   </clock>
Oct 23 22:59:26 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 22:59:26 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 22:59:26 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:59:26 user nova-compute[74482]:   </cpu>
Oct 23 22:59:26 user nova-compute[74482]:   <devices>
Oct 23 22:59:26 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 22:59:26 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:59:26 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk"/>
Oct 23 22:59:26 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 22:59:26 user nova-compute[74482]:     </disk>
Oct 23 22:59:26 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 22:59:26 user nova-compute[74482]:       <mac address="fa:16:3e:c9:0c:ce"/>
Oct 23 22:59:26 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:26 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 22:59:26 user nova-compute[74482]:       <target dev="tapc4bb13fd-21"/>
Oct 23 22:59:26 user nova-compute[74482]:     </interface>
Oct 23 22:59:26 user nova-compute[74482]:     <serial type="pty">
Oct 23 22:59:26 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/console.log" append="off"/>
Oct 23 22:59:26 user nova-compute[74482]:     </serial>
Oct 23 22:59:26 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:59:26 user nova-compute[74482]:     <video>
Oct 23 22:59:26 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:26 user nova-compute[74482]:     </video>
Oct 23 22:59:26 user nova-compute[74482]:     <rng model="virtio">
Oct 23 22:59:26 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:59:26 user nova-compute[74482]:     </rng>
Oct 23 22:59:26 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:59:26 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 22:59:26 user nova-compute[74482]:       <stats period="10"/>
Oct 23 22:59:26 user nova-compute[74482]:     </memballoon>
Oct 23 22:59:26 user nova-compute[74482]:   </devices>
Oct 23 22:59:26 user nova-compute[74482]: </domain>
Oct 23 22:59:26 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1882742069',display_name='tempest-ServerActionsTestOtherA-server-1882742069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1882742069',id=6,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIFqjOSyUZWQsU5gFsbXrBOoj4Cp26qpoZb6ZuADPp+mJaMBG92ILD46Qtgf0LpXdVLgOqmH/QEGrVpFM/l9sAP2h6k2MXu+chElwiN2sa7paHBVT+RCfDr3O/3kW7sqg==',key_name='tempest-keypair-1686845388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-wwjw0rob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=c7e4371a-32f9-4156-bea9-b7c4b5df3100,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0c:ce,bridge_name='br-int',has_traffic_filtering=True,id=c4bb13fd-216f-4510-91df-11b772b3b71e,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb13fd-21') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG os_vif [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0c:ce,bridge_name='br-int',has_traffic_filtering=True,id=c4bb13fd-216f-4510-91df-11b772b3b71e,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb13fd-21') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eda47365-c2a0-5ce7-97a8-1beda0ebf911', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:26 user nova-compute[74482]: INFO nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Took 14.34 seconds to spawn the instance on the hypervisor.
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4bb13fd-21, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4bb13fd-21, col_values=(('qos', UUID('ef551754-e3f5-41f4-b2b6-8aa3b09695f8')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4bb13fd-21, col_values=(('external_ids', {'iface-id': 'c4bb13fd-216f-4510-91df-11b772b3b71e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:0c:ce', 'vm-uuid': 'c7e4371a-32f9-4156-bea9-b7c4b5df3100'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: INFO os_vif [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0c:ce,bridge_name='br-int',has_traffic_filtering=True,id=c4bb13fd-216f-4510-91df-11b772b3b71e,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb13fd-21')
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No VIF found with MAC fa:16:3e:c9:0c:ce, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:59:26 user nova-compute[74482]: INFO nova.compute.manager [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Took 15.63 seconds to build instance.
Oct 23 22:59:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f6daf097-c3e0-496f-aa62-0f0658ec0088 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.893s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-ee76283c-c77a-4f47-80a6-d2caa869b0f3 req-fc0bad3c-a0a8-4e02-8855-11f38820554f service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received event network-vif-plugged-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ee76283c-c77a-4f47-80a6-d2caa869b0f3 req-fc0bad3c-a0a8-4e02-8855-11f38820554f service nova] Acquiring lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ee76283c-c77a-4f47-80a6-d2caa869b0f3 req-fc0bad3c-a0a8-4e02-8855-11f38820554f service nova] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ee76283c-c77a-4f47-80a6-d2caa869b0f3 req-fc0bad3c-a0a8-4e02-8855-11f38820554f service nova] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-ee76283c-c77a-4f47-80a6-d2caa869b0f3 req-fc0bad3c-a0a8-4e02-8855-11f38820554f service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] No waiting events found dispatching network-vif-plugged-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:27 user nova-compute[74482]: WARNING nova.compute.manager [req-ee76283c-c77a-4f47-80a6-d2caa869b0f3 req-fc0bad3c-a0a8-4e02-8855-11f38820554f service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received unexpected event network-vif-plugged-fc58ce30-d69f-4b68-af4b-d9a687840887 for instance with vm_state active and task_state None.
Oct 23 22:59:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-45bd8ca5-3592-4380-9dbf-7a2f928a270d req-6db755b2-cfc9-41fa-92fd-44a23030998c service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45bd8ca5-3592-4380-9dbf-7a2f928a270d req-6db755b2-cfc9-41fa-92fd-44a23030998c service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45bd8ca5-3592-4380-9dbf-7a2f928a270d req-6db755b2-cfc9-41fa-92fd-44a23030998c service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45bd8ca5-3592-4380-9dbf-7a2f928a270d req-6db755b2-cfc9-41fa-92fd-44a23030998c service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-45bd8ca5-3592-4380-9dbf-7a2f928a270d req-6db755b2-cfc9-41fa-92fd-44a23030998c service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:29 user nova-compute[74482]: WARNING nova.compute.manager [req-45bd8ca5-3592-4380-9dbf-7a2f928a270d req-6db755b2-cfc9-41fa-92fd-44a23030998c service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state building and task_state spawning.
Oct 23 22:59:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-5976fa12-aecc-415e-8324-e502986affb3 req-ed674d12-aba2-4b36-87d2-aa4c03238de4 service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received event network-vif-plugged-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5976fa12-aecc-415e-8324-e502986affb3 req-ed674d12-aba2-4b36-87d2-aa4c03238de4 service nova] Acquiring lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5976fa12-aecc-415e-8324-e502986affb3 req-ed674d12-aba2-4b36-87d2-aa4c03238de4 service nova] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5976fa12-aecc-415e-8324-e502986affb3 req-ed674d12-aba2-4b36-87d2-aa4c03238de4 service nova] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-5976fa12-aecc-415e-8324-e502986affb3 req-ed674d12-aba2-4b36-87d2-aa4c03238de4 service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] No waiting events found dispatching network-vif-plugged-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:29 user nova-compute[74482]: WARNING nova.compute.manager [req-5976fa12-aecc-415e-8324-e502986affb3 req-ed674d12-aba2-4b36-87d2-aa4c03238de4 service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received unexpected event network-vif-plugged-fc58ce30-d69f-4b68-af4b-d9a687840887 for instance with vm_state active and task_state None.
Oct 23 22:59:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:31 user nova-compute[74482]: WARNING nova.compute.manager [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state building and task_state spawning.
Oct 23 22:59:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received event network-vif-plugged-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] Acquiring lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] No waiting events found dispatching network-vif-plugged-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:31 user nova-compute[74482]: WARNING nova.compute.manager [req-65cc016a-74af-4438-b6f8-5b8c9860eac2 req-ca386eff-1cfc-432e-9be6-191bf90fa34e service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received unexpected event network-vif-plugged-c4bb13fd-216f-4510-91df-11b772b3b71e for instance with vm_state building and task_state spawning.
Oct 23 22:59:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:59:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance spawned successfully.
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:59:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Instance spawned successfully.
Oct 23 22:59:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Instance spawned successfully.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Instance spawned successfully.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Took 19.33 seconds to spawn the instance on the hypervisor.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Took 18.17 seconds to spawn the instance on the hypervisor.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Took 18.68 seconds to spawn the instance on the hypervisor.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.compute.manager [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Took 20.09 seconds to build instance.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-503a8d44-a589-42f5-9637-072c08278753 req-db2daeae-78d2-4814-a1a4-19579f77d849 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received event network-vif-plugged-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-503a8d44-a589-42f5-9637-072c08278753 req-db2daeae-78d2-4814-a1a4-19579f77d849 service nova] Acquiring lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-503a8d44-a589-42f5-9637-072c08278753 req-db2daeae-78d2-4814-a1a4-19579f77d849 service nova] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-503a8d44-a589-42f5-9637-072c08278753 req-db2daeae-78d2-4814-a1a4-19579f77d849 service nova] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-503a8d44-a589-42f5-9637-072c08278753 req-db2daeae-78d2-4814-a1a4-19579f77d849 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] No waiting events found dispatching network-vif-plugged-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:33 user nova-compute[74482]: WARNING nova.compute.manager [req-503a8d44-a589-42f5-9637-072c08278753 req-db2daeae-78d2-4814-a1a4-19579f77d849 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received unexpected event network-vif-plugged-c4bb13fd-216f-4510-91df-11b772b3b71e for instance with vm_state building and task_state spawning.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9457749-b231-4e41-841b-974aa71075d1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.379s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.compute.manager [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Took 19.62 seconds to build instance.
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.compute.manager [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Took 21.03 seconds to build instance.
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Took 19.41 seconds to spawn the instance on the hypervisor.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef153617-8b9d-4fbe-a2d2-b30f1a6d373c tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.673s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-28e4501b-192f-4c7b-b3bf-362a9747161c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "95802cf3-56ba-4224-a333-e00e54c72166" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.866s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.compute.manager [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Took 20.64 seconds to build instance.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:59:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Instance spawned successfully.
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-27408a7c-4f37-46ac-8069-ca0923e1d557 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.922s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:34 user nova-compute[74482]: INFO nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Took 17.77 seconds to spawn the instance on the hypervisor.
Oct 23 22:59:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:59:34 user nova-compute[74482]: INFO nova.compute.manager [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Took 19.19 seconds to build instance.
Oct 23 22:59:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c8650d71-821e-4db9-98b4-d6a9daf1cf41 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.419s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:59:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:59:34 user nova-compute[74482]: INFO nova.compute.claims [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Claim successful on node user
Oct 23 22:59:35 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:35 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:35 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:59:35 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:59:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:59:35 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 23 22:59:35 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:59:35 user nova-compute[74482]: DEBUG nova.policy [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba015688326e400fbfbdb3c5192742d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920c8f16da7c46f1b39f0b0909a89967', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:59:36 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:59:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:59:36 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Creating image(s)
Oct 23 22:59:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "/opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "/opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "/opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "d27f84ee5f50c41dcc1fa959a40442e76f608050" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "d27f84ee5f50c41dcc1fa959a40442e76f608050" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050.part --force-share --output=json" returned: 0 in 0.334s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:37 user nova-compute[74482]: DEBUG nova.virt.images [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] 58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7 was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 22:59:37 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 22:59:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050.part /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:37 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Successfully created port: e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:59:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050.part /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050.converted" returned: 0 in 0.352s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050.converted --force-share --output=json" returned: 0 in 0.345s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "d27f84ee5f50c41dcc1fa959a40442e76f608050" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.951s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050 --force-share --output=json" returned: 0 in 0.371s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "d27f84ee5f50c41dcc1fa959a40442e76f608050" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "d27f84ee5f50c41dcc1fa959a40442e76f608050" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050 --force-share --output=json" returned: 0 in 0.439s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Successfully updated port: e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:59:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050,backing_fmt=raw /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "refresh_cache-3357081e-0244-4351-8ad9-ac87685f5832" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquired lock "refresh_cache-3357081e-0244-4351-8ad9-ac87685f5832" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-666754e5-b30b-4238-ba23-b1b50c72d7eb req-3e3683a7-3101-4dfa-9064-e49c73acfd1c service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received event network-changed-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-666754e5-b30b-4238-ba23-b1b50c72d7eb req-3e3683a7-3101-4dfa-9064-e49c73acfd1c service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Refreshing instance network info cache due to event network-changed-e036d709-8377-45a6-a582-40ef5b175852. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-666754e5-b30b-4238-ba23-b1b50c72d7eb req-3e3683a7-3101-4dfa-9064-e49c73acfd1c service nova] Acquiring lock "refresh_cache-3357081e-0244-4351-8ad9-ac87685f5832" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050,backing_fmt=raw /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk 1073741824" returned: 0 in 0.211s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "d27f84ee5f50c41dcc1fa959a40442e76f608050" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.708s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050 --force-share --output=json" returned: 0 in 0.467s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Cannot resize image /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Ensure instance console log exists: /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.017s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Updating instance_info_cache with network_info: [{"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Releasing lock "refresh_cache-3357081e-0244-4351-8ad9-ac87685f5832" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Instance network_info: |[{"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-666754e5-b30b-4238-ba23-b1b50c72d7eb req-3e3683a7-3101-4dfa-9064-e49c73acfd1c service nova] Acquired lock "refresh_cache-3357081e-0244-4351-8ad9-ac87685f5832" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.network.neutron [req-666754e5-b30b-4238-ba23-b1b50c72d7eb req-3e3683a7-3101-4dfa-9064-e49c73acfd1c service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Refreshing network info cache for port e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Start _get_guest_xml network_info=[{"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:59:26Z,direct_url=<?>,disk_format='qcow2',id=58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7,min_disk=0,min_ram=0,name='',owner='67c009693eb1420caf566cc257d0b0e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:59:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'encryption_format': None, 'disk_bus': 'scsi', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:59:40 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:40 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:59:26Z,direct_url=<?>,disk_format='qcow2',id=58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7,min_disk=0,min_ram=0,name='',owner='67c009693eb1420caf566cc257d0b0e1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:59:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T22:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-378438857',display_name='tempest-AttachSCSIVolumeTestJSON-server-378438857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-378438857',id=7,image_ref='58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI31YHwj9NQLW826YLHCnDTlu2OMaWRBCNKi6WllvLtD0S8AlN2O5d0++NaBLfMxBXYICTBRzG5QnzOuVewtC4YCSVcuXH0ERneU2tmabAplzmKcs4qLLLF6HKCYb7fbw==',key_name='tempest-keypair-330369939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='920c8f16da7c46f1b39f0b0909a89967',ramdisk_id='',reservation_id='r-6zma8s90',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1758481439',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1758481439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba015688326e400fbfbdb3c5192742d1',uuid=3357081e-0244-4351-8ad9-ac87685f5832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Converting VIF {"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:8b:cd,bridge_name='br-int',has_traffic_filtering=True,id=e036d709-8377-45a6-a582-40ef5b175852,network=Network(c6a352f8-53f5-4cdc-bec7-860fa4ff4c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape036d709-83') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.objects.instance [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lazy-loading 'pci_devices' on Instance uuid 3357081e-0244-4351-8ad9-ac87685f5832 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:59:40 user nova-compute[74482]:   <uuid>3357081e-0244-4351-8ad9-ac87685f5832</uuid>
Oct 23 22:59:40 user nova-compute[74482]:   <name>instance-00000007</name>
Oct 23 22:59:40 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 22:59:40 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 22:59:40 user nova-compute[74482]:   <metadata>
Oct 23 22:59:40 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:59:40 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 22:59:40 user nova-compute[74482]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-378438857</nova:name>
Oct 23 22:59:40 user nova-compute[74482]:       <nova:creationTime>2023-10-23 22:59:40</nova:creationTime>
Oct 23 22:59:40 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 22:59:40 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 22:59:40 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 22:59:40 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 22:59:40 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:59:40 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:59:40 user nova-compute[74482]:       </nova:flavor>
Oct 23 22:59:40 user nova-compute[74482]:       <nova:owner>
Oct 23 22:59:40 user nova-compute[74482]:         <nova:user uuid="ba015688326e400fbfbdb3c5192742d1">tempest-AttachSCSIVolumeTestJSON-1758481439-project-member</nova:user>
Oct 23 22:59:40 user nova-compute[74482]:         <nova:project uuid="920c8f16da7c46f1b39f0b0909a89967">tempest-AttachSCSIVolumeTestJSON-1758481439</nova:project>
Oct 23 22:59:40 user nova-compute[74482]:       </nova:owner>
Oct 23 22:59:40 user nova-compute[74482]:       <nova:root type="image" uuid="58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7"/>
Oct 23 22:59:40 user nova-compute[74482]:       <nova:ports>
Oct 23 22:59:40 user nova-compute[74482]:         <nova:port uuid="e036d709-8377-45a6-a582-40ef5b175852">
Oct 23 22:59:40 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 22:59:40 user nova-compute[74482]:         </nova:port>
Oct 23 22:59:40 user nova-compute[74482]:       </nova:ports>
Oct 23 22:59:40 user nova-compute[74482]:     </nova:instance>
Oct 23 22:59:40 user nova-compute[74482]:   </metadata>
Oct 23 22:59:40 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 22:59:40 user nova-compute[74482]:     <system>
Oct 23 22:59:40 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:59:40 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:59:40 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 22:59:40 user nova-compute[74482]:       <entry name="serial">3357081e-0244-4351-8ad9-ac87685f5832</entry>
Oct 23 22:59:40 user nova-compute[74482]:       <entry name="uuid">3357081e-0244-4351-8ad9-ac87685f5832</entry>
Oct 23 22:59:40 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:59:40 user nova-compute[74482]:     </system>
Oct 23 22:59:40 user nova-compute[74482]:   </sysinfo>
Oct 23 22:59:40 user nova-compute[74482]:   <os>
Oct 23 22:59:40 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:59:40 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 22:59:40 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 22:59:40 user nova-compute[74482]:   </os>
Oct 23 22:59:40 user nova-compute[74482]:   <features>
Oct 23 22:59:40 user nova-compute[74482]:     <acpi/>
Oct 23 22:59:40 user nova-compute[74482]:     <apic/>
Oct 23 22:59:40 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 22:59:40 user nova-compute[74482]:   </features>
Oct 23 22:59:40 user nova-compute[74482]:   <clock offset="utc">
Oct 23 22:59:40 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:59:40 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:59:40 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 22:59:40 user nova-compute[74482]:   </clock>
Oct 23 22:59:40 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 22:59:40 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 22:59:40 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:59:40 user nova-compute[74482]:   </cpu>
Oct 23 22:59:40 user nova-compute[74482]:   <devices>
Oct 23 22:59:40 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 22:59:40 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:59:40 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk"/>
Oct 23 22:59:40 user nova-compute[74482]:       <target dev="sda" bus="scsi"/>
Oct 23 22:59:40 user nova-compute[74482]:       <address type="drive" controller="0" unit="0"/>
Oct 23 22:59:40 user nova-compute[74482]:     </disk>
Oct 23 22:59:40 user nova-compute[74482]:     <disk type="file" device="cdrom">
Oct 23 22:59:40 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 22:59:40 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk.config"/>
Oct 23 22:59:40 user nova-compute[74482]:       <target dev="sdb" bus="scsi"/>
Oct 23 22:59:40 user nova-compute[74482]:       <address type="drive" controller="0" unit="1"/>
Oct 23 22:59:40 user nova-compute[74482]:     </disk>
Oct 23 22:59:40 user nova-compute[74482]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 23 22:59:40 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 22:59:40 user nova-compute[74482]:       <mac address="fa:16:3e:1a:8b:cd"/>
Oct 23 22:59:40 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:40 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 22:59:40 user nova-compute[74482]:       <target dev="tape036d709-83"/>
Oct 23 22:59:40 user nova-compute[74482]:     </interface>
Oct 23 22:59:40 user nova-compute[74482]:     <serial type="pty">
Oct 23 22:59:40 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/console.log" append="off"/>
Oct 23 22:59:40 user nova-compute[74482]:     </serial>
Oct 23 22:59:40 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:59:40 user nova-compute[74482]:     <video>
Oct 23 22:59:40 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:40 user nova-compute[74482]:     </video>
Oct 23 22:59:40 user nova-compute[74482]:     <rng model="virtio">
Oct 23 22:59:40 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:59:40 user nova-compute[74482]:     </rng>
Oct 23 22:59:40 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:59:40 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 22:59:40 user nova-compute[74482]:       <stats period="10"/>
Oct 23 22:59:40 user nova-compute[74482]:     </memballoon>
Oct 23 22:59:40 user nova-compute[74482]:   </devices>
Oct 23 22:59:40 user nova-compute[74482]: </domain>
Oct 23 22:59:40 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T22:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-378438857',display_name='tempest-AttachSCSIVolumeTestJSON-server-378438857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-378438857',id=7,image_ref='58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI31YHwj9NQLW826YLHCnDTlu2OMaWRBCNKi6WllvLtD0S8AlN2O5d0++NaBLfMxBXYICTBRzG5QnzOuVewtC4YCSVcuXH0ERneU2tmabAplzmKcs4qLLLF6HKCYb7fbw==',key_name='tempest-keypair-330369939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='920c8f16da7c46f1b39f0b0909a89967',ramdisk_id='',reservation_id='r-6zma8s90',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1758481439',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1758481439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba015688326e400fbfbdb3c5192742d1',uuid=3357081e-0244-4351-8ad9-ac87685f5832,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Converting VIF {"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:8b:cd,bridge_name='br-int',has_traffic_filtering=True,id=e036d709-8377-45a6-a582-40ef5b175852,network=Network(c6a352f8-53f5-4cdc-bec7-860fa4ff4c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape036d709-83') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG os_vif [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:8b:cd,bridge_name='br-int',has_traffic_filtering=True,id=e036d709-8377-45a6-a582-40ef5b175852,network=Network(c6a352f8-53f5-4cdc-bec7-860fa4ff4c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape036d709-83') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '013dc845-ee83-5e6d-ad1f-8bbd5af03e72', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape036d709-83, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape036d709-83, col_values=(('qos', UUID('70ec76a0-74f3-4f87-a140-d828edc7cc59')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape036d709-83, col_values=(('external_ids', {'iface-id': 'e036d709-8377-45a6-a582-40ef5b175852', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:8b:cd', 'vm-uuid': '3357081e-0244-4351-8ad9-ac87685f5832'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:40 user nova-compute[74482]: INFO os_vif [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:8b:cd,bridge_name='br-int',has_traffic_filtering=True,id=e036d709-8377-45a6-a582-40ef5b175852,network=Network(c6a352f8-53f5-4cdc-bec7-860fa4ff4c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape036d709-83')
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] No BDM found with device name sda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] No VIF found with MAC fa:16:3e:1a:8b:cd, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:59:40 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Using config drive
Oct 23 22:59:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-666754e5-b30b-4238-ba23-b1b50c72d7eb req-3e3683a7-3101-4dfa-9064-e49c73acfd1c service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Updated VIF entry in instance network info cache for port e036d709-8377-45a6-a582-40ef5b175852. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:59:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-666754e5-b30b-4238-ba23-b1b50c72d7eb req-3e3683a7-3101-4dfa-9064-e49c73acfd1c service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Updating instance_info_cache with network_info: [{"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-666754e5-b30b-4238-ba23-b1b50c72d7eb req-3e3683a7-3101-4dfa-9064-e49c73acfd1c service nova] Releasing lock "refresh_cache-3357081e-0244-4351-8ad9-ac87685f5832" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:41 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Creating config drive at /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk.config
Oct 23 22:59:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuxn6aqcv {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuxn6aqcv" returned: 0 in 0.079s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-40a1e99f-b351-436d-8e59-064b14dd7886 req-6b9d9b87-6177-4c11-b119-ebd5bdf42789 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-40a1e99f-b351-436d-8e59-064b14dd7886 req-6b9d9b87-6177-4c11-b119-ebd5bdf42789 service nova] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-40a1e99f-b351-436d-8e59-064b14dd7886 req-6b9d9b87-6177-4c11-b119-ebd5bdf42789 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-40a1e99f-b351-436d-8e59-064b14dd7886 req-6b9d9b87-6177-4c11-b119-ebd5bdf42789 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-40a1e99f-b351-436d-8e59-064b14dd7886 req-6b9d9b87-6177-4c11-b119-ebd5bdf42789 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] No waiting events found dispatching network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:41 user nova-compute[74482]: WARNING nova.compute.manager [req-40a1e99f-b351-436d-8e59-064b14dd7886 req-6b9d9b87-6177-4c11-b119-ebd5bdf42789 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received unexpected event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 for instance with vm_state active and task_state None.
Oct 23 22:59:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-7286e09c-953f-43c8-b90b-3a8d34ec9274 req-9a038972-01e6-416b-9156-bad893d8ddb7 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7286e09c-953f-43c8-b90b-3a8d34ec9274 req-9a038972-01e6-416b-9156-bad893d8ddb7 service nova] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7286e09c-953f-43c8-b90b-3a8d34ec9274 req-9a038972-01e6-416b-9156-bad893d8ddb7 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7286e09c-953f-43c8-b90b-3a8d34ec9274 req-9a038972-01e6-416b-9156-bad893d8ddb7 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-7286e09c-953f-43c8-b90b-3a8d34ec9274 req-9a038972-01e6-416b-9156-bad893d8ddb7 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] No waiting events found dispatching network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:44 user nova-compute[74482]: WARNING nova.compute.manager [req-7286e09c-953f-43c8-b90b-3a8d34ec9274 req-9a038972-01e6-416b-9156-bad893d8ddb7 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received unexpected event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 for instance with vm_state active and task_state None.
Oct 23 22:59:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-122e1b7a-20cf-4e71-b588-b0d820e63179 req-6bf95853-3b5f-4147-9e0c-b9d11f1f27f5 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received event network-vif-plugged-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-122e1b7a-20cf-4e71-b588-b0d820e63179 req-6bf95853-3b5f-4147-9e0c-b9d11f1f27f5 service nova] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-122e1b7a-20cf-4e71-b588-b0d820e63179 req-6bf95853-3b5f-4147-9e0c-b9d11f1f27f5 service nova] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-122e1b7a-20cf-4e71-b588-b0d820e63179 req-6bf95853-3b5f-4147-9e0c-b9d11f1f27f5 service nova] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-122e1b7a-20cf-4e71-b588-b0d820e63179 req-6bf95853-3b5f-4147-9e0c-b9d11f1f27f5 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] No waiting events found dispatching network-vif-plugged-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:44 user nova-compute[74482]: WARNING nova.compute.manager [req-122e1b7a-20cf-4e71-b588-b0d820e63179 req-6bf95853-3b5f-4147-9e0c-b9d11f1f27f5 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received unexpected event network-vif-plugged-e036d709-8377-45a6-a582-40ef5b175852 for instance with vm_state building and task_state spawning.
Oct 23 22:59:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-5688bfa1-8c00-4827-bfda-9d01ef04b0a6 req-fc4040bc-e392-417a-92d2-851c1dac3ed3 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received event network-vif-plugged-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5688bfa1-8c00-4827-bfda-9d01ef04b0a6 req-fc4040bc-e392-417a-92d2-851c1dac3ed3 service nova] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5688bfa1-8c00-4827-bfda-9d01ef04b0a6 req-fc4040bc-e392-417a-92d2-851c1dac3ed3 service nova] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5688bfa1-8c00-4827-bfda-9d01ef04b0a6 req-fc4040bc-e392-417a-92d2-851c1dac3ed3 service nova] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-5688bfa1-8c00-4827-bfda-9d01ef04b0a6 req-fc4040bc-e392-417a-92d2-851c1dac3ed3 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] No waiting events found dispatching network-vif-plugged-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:46 user nova-compute[74482]: WARNING nova.compute.manager [req-5688bfa1-8c00-4827-bfda-9d01ef04b0a6 req-fc4040bc-e392-417a-92d2-851c1dac3ed3 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received unexpected event network-vif-plugged-e036d709-8377-45a6-a582-40ef5b175852 for instance with vm_state building and task_state spawning.
Oct 23 22:59:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:59:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:59:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Instance spawned successfully.
Oct 23 22:59:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:59:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:47 user nova-compute[74482]: INFO nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Took 11.27 seconds to spawn the instance on the hypervisor.
Oct 23 22:59:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:59:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:47 user nova-compute[74482]: INFO nova.compute.manager [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Took 12.84 seconds to build instance.
Oct 23 22:59:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0e677e1c-a2e4-480c-b668-54a3a8fdf906 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.977s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:59:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:59:48 user nova-compute[74482]: INFO nova.compute.claims [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Claim successful on node user
Oct 23 22:59:48 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:48 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:59:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:59:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:59:48 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:59:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:59:48 user nova-compute[74482]: DEBUG nova.policy [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92548c712df94fcfbce368fd943d0b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6de9c2d01774a2bbcad554f40ce9d8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:59:49 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Creating image(s)
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "/opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "/opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.278s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.212s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk 1073741824" returned: 0 in 0.063s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:49 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Successfully created port: 01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.295s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Cannot resize image /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Ensure instance console log exists: /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-e4babe59-bb99-4ff9-b8ea-2d3b1f58d4df req-83fc2d2c-acfe-468e-9156-fe5f2b51ac33 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e4babe59-bb99-4ff9-b8ea-2d3b1f58d4df req-83fc2d2c-acfe-468e-9156-fe5f2b51ac33 service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e4babe59-bb99-4ff9-b8ea-2d3b1f58d4df req-83fc2d2c-acfe-468e-9156-fe5f2b51ac33 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e4babe59-bb99-4ff9-b8ea-2d3b1f58d4df req-83fc2d2c-acfe-468e-9156-fe5f2b51ac33 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-e4babe59-bb99-4ff9-b8ea-2d3b1f58d4df req-83fc2d2c-acfe-468e-9156-fe5f2b51ac33 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:50 user nova-compute[74482]: WARNING nova.compute.manager [req-e4babe59-bb99-4ff9-b8ea-2d3b1f58d4df req-83fc2d2c-acfe-468e-9156-fe5f2b51ac33 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state active and task_state None.
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Successfully updated port: 01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "refresh_cache-e8bdfd0e-24d2-4f31-a650-60edac47fc97" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquired lock "refresh_cache-e8bdfd0e-24d2-4f31-a650-60edac47fc97" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-a9ed13c1-5a56-4334-8aa5-89b896bb7413 req-6a7a4a72-461f-432d-971d-88f58de580b8 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received event network-changed-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-a9ed13c1-5a56-4334-8aa5-89b896bb7413 req-6a7a4a72-461f-432d-971d-88f58de580b8 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Refreshing instance network info cache due to event network-changed-01bf792d-71d9-4ebb-822a-b3ed3b696af2. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a9ed13c1-5a56-4334-8aa5-89b896bb7413 req-6a7a4a72-461f-432d-971d-88f58de580b8 service nova] Acquiring lock "refresh_cache-e8bdfd0e-24d2-4f31-a650-60edac47fc97" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Updating instance_info_cache with network_info: [{"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Releasing lock "refresh_cache-e8bdfd0e-24d2-4f31-a650-60edac47fc97" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Instance network_info: |[{"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a9ed13c1-5a56-4334-8aa5-89b896bb7413 req-6a7a4a72-461f-432d-971d-88f58de580b8 service nova] Acquired lock "refresh_cache-e8bdfd0e-24d2-4f31-a650-60edac47fc97" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-a9ed13c1-5a56-4334-8aa5-89b896bb7413 req-6a7a4a72-461f-432d-971d-88f58de580b8 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Refreshing network info cache for port 01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Start _get_guest_xml network_info=[{"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:59:51 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:51 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1472035309',display_name='tempest-TestVolumeSwap-server-1472035309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1472035309',id=8,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxJL7TJEE8TYIXXzw4QMbhMkB3aPqm3OJbcAY6YvI/eDYL+DKlVxIU8Ze8ndQZcYoVP9iQP1nhl6IyRnOXE74r9WHwvOsCf7WLJLhhY4Tvn3mT8bUR6V1ftvl8vC8iODA==',key_name='tempest-keypair-1789462894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6de9c2d01774a2bbcad554f40ce9d8a',ramdisk_id='',reservation_id='r-x650kg5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-145807861',owner_user_name='tempest-TestVolumeSwap-145807861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92548c712df94fcfbce368fd943d0b6f',uuid=e8bdfd0e-24d2-4f31-a650-60edac47fc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Converting VIF {"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:23:61,bridge_name='br-int',has_traffic_filtering=True,id=01bf792d-71d9-4ebb-822a-b3ed3b696af2,network=Network(643e2873-2623-45e5-8322-3b68049f2295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf792d-71') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lazy-loading 'pci_devices' on Instance uuid e8bdfd0e-24d2-4f31-a650-60edac47fc97 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:59:51 user nova-compute[74482]:   <uuid>e8bdfd0e-24d2-4f31-a650-60edac47fc97</uuid>
Oct 23 22:59:51 user nova-compute[74482]:   <name>instance-00000008</name>
Oct 23 22:59:51 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 22:59:51 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 22:59:51 user nova-compute[74482]:   <metadata>
Oct 23 22:59:51 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:59:51 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 22:59:51 user nova-compute[74482]:       <nova:name>tempest-TestVolumeSwap-server-1472035309</nova:name>
Oct 23 22:59:51 user nova-compute[74482]:       <nova:creationTime>2023-10-23 22:59:51</nova:creationTime>
Oct 23 22:59:51 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 22:59:51 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 22:59:51 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 22:59:51 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 22:59:51 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:59:51 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:59:51 user nova-compute[74482]:       </nova:flavor>
Oct 23 22:59:51 user nova-compute[74482]:       <nova:owner>
Oct 23 22:59:51 user nova-compute[74482]:         <nova:user uuid="92548c712df94fcfbce368fd943d0b6f">tempest-TestVolumeSwap-145807861-project-member</nova:user>
Oct 23 22:59:51 user nova-compute[74482]:         <nova:project uuid="d6de9c2d01774a2bbcad554f40ce9d8a">tempest-TestVolumeSwap-145807861</nova:project>
Oct 23 22:59:51 user nova-compute[74482]:       </nova:owner>
Oct 23 22:59:51 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 22:59:51 user nova-compute[74482]:       <nova:ports>
Oct 23 22:59:51 user nova-compute[74482]:         <nova:port uuid="01bf792d-71d9-4ebb-822a-b3ed3b696af2">
Oct 23 22:59:51 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 22:59:51 user nova-compute[74482]:         </nova:port>
Oct 23 22:59:51 user nova-compute[74482]:       </nova:ports>
Oct 23 22:59:51 user nova-compute[74482]:     </nova:instance>
Oct 23 22:59:51 user nova-compute[74482]:   </metadata>
Oct 23 22:59:51 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 22:59:51 user nova-compute[74482]:     <system>
Oct 23 22:59:51 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:59:51 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:59:51 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 22:59:51 user nova-compute[74482]:       <entry name="serial">e8bdfd0e-24d2-4f31-a650-60edac47fc97</entry>
Oct 23 22:59:51 user nova-compute[74482]:       <entry name="uuid">e8bdfd0e-24d2-4f31-a650-60edac47fc97</entry>
Oct 23 22:59:51 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:59:51 user nova-compute[74482]:     </system>
Oct 23 22:59:51 user nova-compute[74482]:   </sysinfo>
Oct 23 22:59:51 user nova-compute[74482]:   <os>
Oct 23 22:59:51 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:59:51 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 22:59:51 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 22:59:51 user nova-compute[74482]:   </os>
Oct 23 22:59:51 user nova-compute[74482]:   <features>
Oct 23 22:59:51 user nova-compute[74482]:     <acpi/>
Oct 23 22:59:51 user nova-compute[74482]:     <apic/>
Oct 23 22:59:51 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 22:59:51 user nova-compute[74482]:   </features>
Oct 23 22:59:51 user nova-compute[74482]:   <clock offset="utc">
Oct 23 22:59:51 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:59:51 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:59:51 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 22:59:51 user nova-compute[74482]:   </clock>
Oct 23 22:59:51 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 22:59:51 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 22:59:51 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:59:51 user nova-compute[74482]:   </cpu>
Oct 23 22:59:51 user nova-compute[74482]:   <devices>
Oct 23 22:59:51 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 22:59:51 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:59:51 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk"/>
Oct 23 22:59:51 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 22:59:51 user nova-compute[74482]:     </disk>
Oct 23 22:59:51 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 22:59:51 user nova-compute[74482]:       <mac address="fa:16:3e:e4:23:61"/>
Oct 23 22:59:51 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:51 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 22:59:51 user nova-compute[74482]:       <target dev="tap01bf792d-71"/>
Oct 23 22:59:51 user nova-compute[74482]:     </interface>
Oct 23 22:59:51 user nova-compute[74482]:     <serial type="pty">
Oct 23 22:59:51 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/console.log" append="off"/>
Oct 23 22:59:51 user nova-compute[74482]:     </serial>
Oct 23 22:59:51 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:59:51 user nova-compute[74482]:     <video>
Oct 23 22:59:51 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:51 user nova-compute[74482]:     </video>
Oct 23 22:59:51 user nova-compute[74482]:     <rng model="virtio">
Oct 23 22:59:51 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:59:51 user nova-compute[74482]:     </rng>
Oct 23 22:59:51 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:59:51 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 22:59:51 user nova-compute[74482]:       <stats period="10"/>
Oct 23 22:59:51 user nova-compute[74482]:     </memballoon>
Oct 23 22:59:51 user nova-compute[74482]:   </devices>
Oct 23 22:59:51 user nova-compute[74482]: </domain>
Oct 23 22:59:51 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1472035309',display_name='tempest-TestVolumeSwap-server-1472035309',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1472035309',id=8,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxJL7TJEE8TYIXXzw4QMbhMkB3aPqm3OJbcAY6YvI/eDYL+DKlVxIU8Ze8ndQZcYoVP9iQP1nhl6IyRnOXE74r9WHwvOsCf7WLJLhhY4Tvn3mT8bUR6V1ftvl8vC8iODA==',key_name='tempest-keypair-1789462894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6de9c2d01774a2bbcad554f40ce9d8a',ramdisk_id='',reservation_id='r-x650kg5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-145807861',owner_user_name='tempest-TestVolumeSwap-145807861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92548c712df94fcfbce368fd943d0b6f',uuid=e8bdfd0e-24d2-4f31-a650-60edac47fc97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Converting VIF {"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:23:61,bridge_name='br-int',has_traffic_filtering=True,id=01bf792d-71d9-4ebb-822a-b3ed3b696af2,network=Network(643e2873-2623-45e5-8322-3b68049f2295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf792d-71') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG os_vif [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:23:61,bridge_name='br-int',has_traffic_filtering=True,id=01bf792d-71d9-4ebb-822a-b3ed3b696af2,network=Network(643e2873-2623-45e5-8322-3b68049f2295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf792d-71') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '342c47ea-853d-533c-bc02-e783fcadb23a', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01bf792d-71, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01bf792d-71, col_values=(('qos', UUID('e4127abd-c111-4869-91e5-4604dd15bd6a')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01bf792d-71, col_values=(('external_ids', {'iface-id': '01bf792d-71d9-4ebb-822a-b3ed3b696af2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:23:61', 'vm-uuid': 'e8bdfd0e-24d2-4f31-a650-60edac47fc97'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:51 user nova-compute[74482]: INFO os_vif [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:23:61,bridge_name='br-int',has_traffic_filtering=True,id=01bf792d-71d9-4ebb-822a-b3ed3b696af2,network=Network(643e2873-2623-45e5-8322-3b68049f2295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf792d-71')
Oct 23 22:59:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] No VIF found with MAC fa:16:3e:e4:23:61, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:59:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-a9ed13c1-5a56-4334-8aa5-89b896bb7413 req-6a7a4a72-461f-432d-971d-88f58de580b8 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Updated VIF entry in instance network info cache for port 01bf792d-71d9-4ebb-822a-b3ed3b696af2. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:59:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-a9ed13c1-5a56-4334-8aa5-89b896bb7413 req-6a7a4a72-461f-432d-971d-88f58de580b8 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Updating instance_info_cache with network_info: [{"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a9ed13c1-5a56-4334-8aa5-89b896bb7413 req-6a7a4a72-461f-432d-971d-88f58de580b8 service nova] Releasing lock "refresh_cache-e8bdfd0e-24d2-4f31-a650-60edac47fc97" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:53 user nova-compute[74482]: WARNING nova.compute.manager [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state active and task_state None.
Oct 23 22:59:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:53 user nova-compute[74482]: WARNING nova.compute.manager [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state active and task_state None.
Oct 23 22:59:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:53 user nova-compute[74482]: WARNING nova.compute.manager [req-d06401a0-6d25-43be-88c2-58ac520d2b1e req-e650602d-508b-4cb0-872d-10cbc406aa3a service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state active and task_state None.
Oct 23 22:59:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:59:54 user nova-compute[74482]: INFO nova.compute.claims [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Claim successful on node user
Oct 23 22:59:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:59:54 user nova-compute[74482]: DEBUG nova.network.neutron [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:59:54 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:59:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG nova.policy [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '439d4186957c4d7780483480461b7322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfcf38ea83f473c8aeb37253e9deb4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received event network-vif-plugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] No waiting events found dispatching network-vif-plugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:55 user nova-compute[74482]: WARNING nova.compute.manager [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received unexpected event network-vif-plugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 for instance with vm_state building and task_state spawning.
Oct 23 22:59:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received event network-vif-plugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] No waiting events found dispatching network-vif-plugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:55 user nova-compute[74482]: WARNING nova.compute.manager [req-78f7e0c8-6347-4f08-a2bb-849c3bdb17f3 req-5dde3492-4e2d-4c1b-975d-772f3fd0ec6c service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received unexpected event network-vif-plugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 for instance with vm_state building and task_state spawning.
Oct 23 22:59:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:59:55 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Creating image(s)
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquiring lock "/opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "/opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "/opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.225s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk 1073741824" returned: 0 in 0.055s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Successfully created port: 4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:59:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Cannot resize image /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Ensure instance console log exists: /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:59:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Instance spawned successfully.
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Successfully updated port: 4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquiring lock "refresh_cache-903923e6-8faa-4c46-9b5f-1b611f6902dc" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquired lock "refresh_cache-903923e6-8faa-4c46-9b5f-1b611f6902dc" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d4ff576-3a61-4fcf-8f19-bc8538477246 req-0bdcdc72-4307-4a45-91ea-6a21cb8c98b5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received event network-changed-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d4ff576-3a61-4fcf-8f19-bc8538477246 req-0bdcdc72-4307-4a45-91ea-6a21cb8c98b5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Refreshing instance network info cache due to event network-changed-4d273b5c-85c1-42f9-b31a-321932d97e42. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d4ff576-3a61-4fcf-8f19-bc8538477246 req-0bdcdc72-4307-4a45-91ea-6a21cb8c98b5 service nova] Acquiring lock "refresh_cache-903923e6-8faa-4c46-9b5f-1b611f6902dc" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:59:56 user nova-compute[74482]: INFO nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Took 7.18 seconds to spawn the instance on the hypervisor.
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:59:56 user nova-compute[74482]: INFO nova.compute.manager [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Took 8.54 seconds to build instance.
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c14e8baf-2e62-48ba-adad-7a023947272c tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.788s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Updating instance_info_cache with network_info: [{"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Releasing lock "refresh_cache-903923e6-8faa-4c46-9b5f-1b611f6902dc" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Instance network_info: |[{"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d4ff576-3a61-4fcf-8f19-bc8538477246 req-0bdcdc72-4307-4a45-91ea-6a21cb8c98b5 service nova] Acquired lock "refresh_cache-903923e6-8faa-4c46-9b5f-1b611f6902dc" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.network.neutron [req-8d4ff576-3a61-4fcf-8f19-bc8538477246 req-0bdcdc72-4307-4a45-91ea-6a21cb8c98b5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Refreshing network info cache for port 4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Start _get_guest_xml network_info=[{"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:59:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1961202639',display_name='tempest-VolumesAssistedSnapshotsTest-server-1961202639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1961202639',id=9,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeaKDfacBidYuwA3kgr4qYef57CgbIJ/kF3oDmojQ00Y90Q9NkNoKWf4t3Kdwx1ju/kATrq9OJ/Y1NJQIZpauQgeCW2M7IklsUBSzrEotHuooqTN6mJhob82OKVzdyBXA==',key_name='tempest-keypair-1690234251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbfcf38ea83f473c8aeb37253e9deb4a',ramdisk_id='',reservation_id='r-elmev2al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1397661992',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1397661992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439d4186957c4d7780483480461b7322',uuid=903923e6-8faa-4c46-9b5f-1b611f6902dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Converting VIF {"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=4d273b5c-85c1-42f9-b31a-321932d97e42,network=Network(0760bf31-70d9-48fd-8398-48e0440eabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d273b5c-85') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.objects.instance [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lazy-loading 'pci_devices' on Instance uuid 903923e6-8faa-4c46-9b5f-1b611f6902dc {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:59:56 user nova-compute[74482]:   <uuid>903923e6-8faa-4c46-9b5f-1b611f6902dc</uuid>
Oct 23 22:59:56 user nova-compute[74482]:   <name>instance-00000009</name>
Oct 23 22:59:56 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 22:59:56 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 22:59:56 user nova-compute[74482]:   <metadata>
Oct 23 22:59:56 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:59:56 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 22:59:56 user nova-compute[74482]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1961202639</nova:name>
Oct 23 22:59:56 user nova-compute[74482]:       <nova:creationTime>2023-10-23 22:59:56</nova:creationTime>
Oct 23 22:59:56 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 22:59:56 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 22:59:56 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 22:59:56 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 22:59:56 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:59:56 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:59:56 user nova-compute[74482]:       </nova:flavor>
Oct 23 22:59:56 user nova-compute[74482]:       <nova:owner>
Oct 23 22:59:56 user nova-compute[74482]:         <nova:user uuid="439d4186957c4d7780483480461b7322">tempest-VolumesAssistedSnapshotsTest-1397661992-project-member</nova:user>
Oct 23 22:59:56 user nova-compute[74482]:         <nova:project uuid="fbfcf38ea83f473c8aeb37253e9deb4a">tempest-VolumesAssistedSnapshotsTest-1397661992</nova:project>
Oct 23 22:59:56 user nova-compute[74482]:       </nova:owner>
Oct 23 22:59:56 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 22:59:56 user nova-compute[74482]:       <nova:ports>
Oct 23 22:59:56 user nova-compute[74482]:         <nova:port uuid="4d273b5c-85c1-42f9-b31a-321932d97e42">
Oct 23 22:59:56 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 22:59:56 user nova-compute[74482]:         </nova:port>
Oct 23 22:59:56 user nova-compute[74482]:       </nova:ports>
Oct 23 22:59:56 user nova-compute[74482]:     </nova:instance>
Oct 23 22:59:56 user nova-compute[74482]:   </metadata>
Oct 23 22:59:56 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 22:59:56 user nova-compute[74482]:     <system>
Oct 23 22:59:56 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:59:56 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:59:56 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 22:59:56 user nova-compute[74482]:       <entry name="serial">903923e6-8faa-4c46-9b5f-1b611f6902dc</entry>
Oct 23 22:59:56 user nova-compute[74482]:       <entry name="uuid">903923e6-8faa-4c46-9b5f-1b611f6902dc</entry>
Oct 23 22:59:56 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:59:56 user nova-compute[74482]:     </system>
Oct 23 22:59:56 user nova-compute[74482]:   </sysinfo>
Oct 23 22:59:56 user nova-compute[74482]:   <os>
Oct 23 22:59:56 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:59:56 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 22:59:56 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 22:59:56 user nova-compute[74482]:   </os>
Oct 23 22:59:56 user nova-compute[74482]:   <features>
Oct 23 22:59:56 user nova-compute[74482]:     <acpi/>
Oct 23 22:59:56 user nova-compute[74482]:     <apic/>
Oct 23 22:59:56 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 22:59:56 user nova-compute[74482]:   </features>
Oct 23 22:59:56 user nova-compute[74482]:   <clock offset="utc">
Oct 23 22:59:56 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:59:56 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:59:56 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 22:59:56 user nova-compute[74482]:   </clock>
Oct 23 22:59:56 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 22:59:56 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 22:59:56 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:59:56 user nova-compute[74482]:   </cpu>
Oct 23 22:59:56 user nova-compute[74482]:   <devices>
Oct 23 22:59:56 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 22:59:56 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:59:56 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk"/>
Oct 23 22:59:56 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 22:59:56 user nova-compute[74482]:     </disk>
Oct 23 22:59:56 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 22:59:56 user nova-compute[74482]:       <mac address="fa:16:3e:7a:9c:23"/>
Oct 23 22:59:56 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:56 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 22:59:56 user nova-compute[74482]:       <target dev="tap4d273b5c-85"/>
Oct 23 22:59:56 user nova-compute[74482]:     </interface>
Oct 23 22:59:56 user nova-compute[74482]:     <serial type="pty">
Oct 23 22:59:56 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/console.log" append="off"/>
Oct 23 22:59:56 user nova-compute[74482]:     </serial>
Oct 23 22:59:56 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:59:56 user nova-compute[74482]:     <video>
Oct 23 22:59:56 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 22:59:56 user nova-compute[74482]:     </video>
Oct 23 22:59:56 user nova-compute[74482]:     <rng model="virtio">
Oct 23 22:59:56 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:59:56 user nova-compute[74482]:     </rng>
Oct 23 22:59:56 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:59:56 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 22:59:56 user nova-compute[74482]:       <stats period="10"/>
Oct 23 22:59:56 user nova-compute[74482]:     </memballoon>
Oct 23 22:59:56 user nova-compute[74482]:   </devices>
Oct 23 22:59:56 user nova-compute[74482]: </domain>
Oct 23 22:59:56 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1961202639',display_name='tempest-VolumesAssistedSnapshotsTest-server-1961202639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1961202639',id=9,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeaKDfacBidYuwA3kgr4qYef57CgbIJ/kF3oDmojQ00Y90Q9NkNoKWf4t3Kdwx1ju/kATrq9OJ/Y1NJQIZpauQgeCW2M7IklsUBSzrEotHuooqTN6mJhob82OKVzdyBXA==',key_name='tempest-keypair-1690234251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbfcf38ea83f473c8aeb37253e9deb4a',ramdisk_id='',reservation_id='r-elmev2al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1397661992',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1397661992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439d4186957c4d7780483480461b7322',uuid=903923e6-8faa-4c46-9b5f-1b611f6902dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Converting VIF {"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=4d273b5c-85c1-42f9-b31a-321932d97e42,network=Network(0760bf31-70d9-48fd-8398-48e0440eabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d273b5c-85') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG os_vif [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=4d273b5c-85c1-42f9-b31a-321932d97e42,network=Network(0760bf31-70d9-48fd-8398-48e0440eabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d273b5c-85') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f28159a-d308-545a-bd5f-0220b4dd5c85', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d273b5c-85, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d273b5c-85, col_values=(('qos', UUID('73dd4bb1-e381-443b-beb0-49e612355196')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d273b5c-85, col_values=(('external_ids', {'iface-id': '4d273b5c-85c1-42f9-b31a-321932d97e42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:9c:23', 'vm-uuid': '903923e6-8faa-4c46-9b5f-1b611f6902dc'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:56 user nova-compute[74482]: INFO os_vif [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=4d273b5c-85c1-42f9-b31a-321932d97e42,network=Network(0760bf31-70d9-48fd-8398-48e0440eabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d273b5c-85')
Oct 23 22:59:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] No VIF found with MAC fa:16:3e:7a:9c:23, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-8d4ff576-3a61-4fcf-8f19-bc8538477246 req-0bdcdc72-4307-4a45-91ea-6a21cb8c98b5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Updated VIF entry in instance network info cache for port 4d273b5c-85c1-42f9-b31a-321932d97e42. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-8d4ff576-3a61-4fcf-8f19-bc8538477246 req-0bdcdc72-4307-4a45-91ea-6a21cb8c98b5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Updating instance_info_cache with network_info: [{"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d4ff576-3a61-4fcf-8f19-bc8538477246 req-0bdcdc72-4307-4a45-91ea-6a21cb8c98b5 service nova] Releasing lock "refresh_cache-903923e6-8faa-4c46-9b5f-1b611f6902dc" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 22:59:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:59:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-d0e3ba78-2333-4f74-9a28-e175a1aae13c req-f0dc55ba-3fdd-426a-b1d4-93fb3b1d747f service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received event network-vif-plugged-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:59:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d0e3ba78-2333-4f74-9a28-e175a1aae13c req-f0dc55ba-3fdd-426a-b1d4-93fb3b1d747f service nova] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:59:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d0e3ba78-2333-4f74-9a28-e175a1aae13c req-f0dc55ba-3fdd-426a-b1d4-93fb3b1d747f service nova] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:59:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d0e3ba78-2333-4f74-9a28-e175a1aae13c req-f0dc55ba-3fdd-426a-b1d4-93fb3b1d747f service nova] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:59:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-d0e3ba78-2333-4f74-9a28-e175a1aae13c req-f0dc55ba-3fdd-426a-b1d4-93fb3b1d747f service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] No waiting events found dispatching network-vif-plugged-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:59:58 user nova-compute[74482]: WARNING nova.compute.manager [req-d0e3ba78-2333-4f74-9a28-e175a1aae13c req-f0dc55ba-3fdd-426a-b1d4-93fb3b1d747f service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received unexpected event network-vif-plugged-4d273b5c-85c1-42f9-b31a-321932d97e42 for instance with vm_state building and task_state spawning.
Oct 23 22:59:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:59:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-4f831e44-db7e-4a78-9776-ed6925eb9a46 req-49b8547c-b73c-45aa-a336-724776304f4e service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received event network-vif-plugged-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:00:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4f831e44-db7e-4a78-9776-ed6925eb9a46 req-49b8547c-b73c-45aa-a336-724776304f4e service nova] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:00:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4f831e44-db7e-4a78-9776-ed6925eb9a46 req-49b8547c-b73c-45aa-a336-724776304f4e service nova] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:00:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4f831e44-db7e-4a78-9776-ed6925eb9a46 req-49b8547c-b73c-45aa-a336-724776304f4e service nova] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:00:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-4f831e44-db7e-4a78-9776-ed6925eb9a46 req-49b8547c-b73c-45aa-a336-724776304f4e service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] No waiting events found dispatching network-vif-plugged-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:00:00 user nova-compute[74482]: WARNING nova.compute.manager [req-4f831e44-db7e-4a78-9776-ed6925eb9a46 req-49b8547c-b73c-45aa-a336-724776304f4e service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received unexpected event network-vif-plugged-4d273b5c-85c1-42f9-b31a-321932d97e42 for instance with vm_state building and task_state spawning.
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:00:01 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Instance spawned successfully.
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:00:01 user nova-compute[74482]: INFO nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Took 6.59 seconds to spawn the instance on the hypervisor.
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Skipping network cache update for instance because it is Building. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid fc2566c6-8911-425b-b05d-a008e67a9d34 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:00:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:01 user nova-compute[74482]: INFO nova.compute.manager [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Took 7.72 seconds to build instance.
Oct 23 23:00:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-473ce9b1-a895-4553-9c74-f79a2d81b1e7 tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.863s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updating instance_info_cache with network_info: [{"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:00:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:00:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:00:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:00:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:00:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:00:04 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:00:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:00:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:00:09 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:00:09 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:00:09 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7369MB free_disk=25.45555877685547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:00:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:00:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa063829-b117-40f4-93f2-358b33f1d156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 3357081e-0244-4351-8ad9-ac87685f5832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 903923e6-8faa-4c46-9b5f-1b611f6902dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:00:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.028s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:00:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:00:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:00:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:01:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:01:01 user nova-compute[74482]: INFO nova.compute.manager [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] instance snapshotting
Oct 23 23:01:01 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Beginning live snapshot process
Oct 23 23:01:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:01:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:01:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:01:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:01:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json -f qcow2 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json -f qcow2 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpalwvay2i/b9273758bbd6426eb3bba37a2b6d5fd0.delta 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpalwvay2i/b9273758bbd6426eb3bba37a2b6d5fd0.delta 1073741824" returned: 0 in 0.061s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:02 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 23:01:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74482) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 23 23:01:02 user nova-compute[74482]: INFO nova.virt.libvirt.host [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] UEFI support detected
Oct 23 23:01:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-215d94b6-143c-41ad-98c5-a950c207ad26 req-6d53bc06-5d22-49b8-bbca-85ca3712e76f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-changed-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-215d94b6-143c-41ad-98c5-a950c207ad26 req-6d53bc06-5d22-49b8-bbca-85ca3712e76f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Refreshing instance network info cache due to event network-changed-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-215d94b6-143c-41ad-98c5-a950c207ad26 req-6d53bc06-5d22-49b8-bbca-85ca3712e76f service nova] Acquiring lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-215d94b6-143c-41ad-98c5-a950c207ad26 req-6d53bc06-5d22-49b8-bbca-85ca3712e76f service nova] Acquired lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:03 user nova-compute[74482]: DEBUG nova.network.neutron [req-215d94b6-143c-41ad-98c5-a950c207ad26 req-6d53bc06-5d22-49b8-bbca-85ca3712e76f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Refreshing network info cache for port 26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:01:04 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 23:01:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-215d94b6-143c-41ad-98c5-a950c207ad26 req-6d53bc06-5d22-49b8-bbca-85ca3712e76f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updated VIF entry in instance network info cache for port 26dfbe86-3706-4d55-8a27-3e7d97ffbaa3. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-215d94b6-143c-41ad-98c5-a950c207ad26 req-6d53bc06-5d22-49b8-bbca-85ca3712e76f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance_info_cache with network_info: [{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-215d94b6-143c-41ad-98c5-a950c207ad26 req-6d53bc06-5d22-49b8-bbca-85ca3712e76f service nova] Releasing lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpalwvay2i/b9273758bbd6426eb3bba37a2b6d5fd0.delta /opt/stack/data/nova/instances/snapshots/tmpalwvay2i/b9273758bbd6426eb3bba37a2b6d5fd0 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:04 user nova-compute[74482]: INFO nova.compute.manager [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Rescuing
Oct 23 23:01:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquired lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-b661eb44-dbdd-40df-92ca-de4cb7fe14c0 req-5fd100e3-b958-4e8e-8de2-5e63fe5f75dd service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-changed-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-b661eb44-dbdd-40df-92ca-de4cb7fe14c0 req-5fd100e3-b958-4e8e-8de2-5e63fe5f75dd service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Refreshing instance network info cache due to event network-changed-dddb3b05-0e78-459a-ae09-5db2fd55bf4c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b661eb44-dbdd-40df-92ca-de4cb7fe14c0 req-5fd100e3-b958-4e8e-8de2-5e63fe5f75dd service nova] Acquiring lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b661eb44-dbdd-40df-92ca-de4cb7fe14c0 req-5fd100e3-b958-4e8e-8de2-5e63fe5f75dd service nova] Acquired lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-b661eb44-dbdd-40df-92ca-de4cb7fe14c0 req-5fd100e3-b958-4e8e-8de2-5e63fe5f75dd service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Refreshing network info cache for port dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpalwvay2i/b9273758bbd6426eb3bba37a2b6d5fd0.delta /opt/stack/data/nova/instances/snapshots/tmpalwvay2i/b9273758bbd6426eb3bba37a2b6d5fd0" returned: 0 in 0.587s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:04 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Snapshot extracted, beginning image upload
Oct 23 23:01:05 user nova-compute[74482]: DEBUG nova.network.neutron [req-b661eb44-dbdd-40df-92ca-de4cb7fe14c0 req-5fd100e3-b958-4e8e-8de2-5e63fe5f75dd service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updated VIF entry in instance network info cache for port dddb3b05-0e78-459a-ae09-5db2fd55bf4c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG nova.network.neutron [req-b661eb44-dbdd-40df-92ca-de4cb7fe14c0 req-5fd100e3-b958-4e8e-8de2-5e63fe5f75dd service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating instance_info_cache with network_info: [{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b661eb44-dbdd-40df-92ca-de4cb7fe14c0 req-5fd100e3-b958-4e8e-8de2-5e63fe5f75dd service nova] Releasing lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG nova.network.neutron [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Updating instance_info_cache with network_info: [{"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Releasing lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Instance destroyed successfully.
Oct 23 23:01:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Attempting rescue
Oct 23 23:01:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Instance directory exists: not creating {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 23:01:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Creating image(s)
Oct 23 23:01:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'trusted_certs' on Instance uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:01:06 user nova-compute[74482]: INFO nova.compute.manager [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] instance snapshotting
Oct 23 23:01:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Beginning live snapshot process
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.222s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue" returned: 0 in 0.058s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'migration_context' on Instance uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-893594ed-d106-4269-b599-9da42963f229 req-f6b992a6-b100-451f-9b44-a568bf94b2c9 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received event network-changed-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-893594ed-d106-4269-b599-9da42963f229 req-f6b992a6-b100-451f-9b44-a568bf94b2c9 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Refreshing instance network info cache due to event network-changed-c4bb13fd-216f-4510-91df-11b772b3b71e. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-893594ed-d106-4269-b599-9da42963f229 req-f6b992a6-b100-451f-9b44-a568bf94b2c9 service nova] Acquiring lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-893594ed-d106-4269-b599-9da42963f229 req-f6b992a6-b100-451f-9b44-a568bf94b2c9 service nova] Acquired lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.network.neutron [req-893594ed-d106-4269-b599-9da42963f229 req-f6b992a6-b100-451f-9b44-a568bf94b2c9 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Refreshing network info cache for port c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.base [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<95802cf3-56ba-4224-a333-e00e54c72166> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Start _get_guest_xml network_info=[{"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "vif_mac": "fa:16:3e:ec:09:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8269c4ae-64d4-478e-8976-b601953bda88', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'resources' on Instance uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.base [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<95802cf3-56ba-4224-a333-e00e54c72166> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'numa_topology' on Instance uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.base [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<95802cf3-56ba-4224-a333-e00e54c72166> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:01:06 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:01:06 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.base [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<95802cf3-56ba-4224-a333-e00e54c72166> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-441054838',display_name='tempest-ServerRescueNegativeTestJSON-server-441054838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-441054838',id=5,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-u4d3wnl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:34Z,user_data=None,user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=95802cf3-56ba-4224-a333-e00e54c72166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "vif_mac": "fa:16:3e:ec:09:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "vif_mac": "fa:16:3e:ec:09:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:09:58,bridge_name='br-int',has_traffic_filtering=True,id=d778946c-6512-4fb7-a247-910aaf4a3ea4,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd778946c-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'pci_devices' on Instance uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.objects.base [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<95802cf3-56ba-4224-a333-e00e54c72166> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:01:06 user nova-compute[74482]:   <uuid>95802cf3-56ba-4224-a333-e00e54c72166</uuid>
Oct 23 23:01:06 user nova-compute[74482]:   <name>instance-00000005</name>
Oct 23 23:01:06 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:01:06 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:01:06 user nova-compute[74482]:   <metadata>
Oct 23 23:01:06 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:01:06 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:01:06 user nova-compute[74482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-441054838</nova:name>
Oct 23 23:01:06 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:01:06</nova:creationTime>
Oct 23 23:01:06 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:01:06 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:01:06 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:01:06 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:01:06 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:01:06 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:01:06 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:01:06 user nova-compute[74482]:       <nova:owner>
Oct 23 23:01:06 user nova-compute[74482]:         <nova:user uuid="2dfe9260c1b8446fbcda07a9dcfa65fb">tempest-ServerRescueNegativeTestJSON-1888569284-project-member</nova:user>
Oct 23 23:01:06 user nova-compute[74482]:         <nova:project uuid="c07328e2befa472d804361a59ac16829">tempest-ServerRescueNegativeTestJSON-1888569284</nova:project>
Oct 23 23:01:06 user nova-compute[74482]:       </nova:owner>
Oct 23 23:01:06 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:01:06 user nova-compute[74482]:       <nova:ports>
Oct 23 23:01:06 user nova-compute[74482]:         <nova:port uuid="d778946c-6512-4fb7-a247-910aaf4a3ea4">
Oct 23 23:01:06 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 23:01:06 user nova-compute[74482]:         </nova:port>
Oct 23 23:01:06 user nova-compute[74482]:       </nova:ports>
Oct 23 23:01:06 user nova-compute[74482]:     </nova:instance>
Oct 23 23:01:06 user nova-compute[74482]:   </metadata>
Oct 23 23:01:06 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:01:06 user nova-compute[74482]:     <system>
Oct 23 23:01:06 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:01:06 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:01:06 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:01:06 user nova-compute[74482]:       <entry name="serial">95802cf3-56ba-4224-a333-e00e54c72166</entry>
Oct 23 23:01:06 user nova-compute[74482]:       <entry name="uuid">95802cf3-56ba-4224-a333-e00e54c72166</entry>
Oct 23 23:01:06 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:01:06 user nova-compute[74482]:     </system>
Oct 23 23:01:06 user nova-compute[74482]:   </sysinfo>
Oct 23 23:01:06 user nova-compute[74482]:   <os>
Oct 23 23:01:06 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:01:06 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:01:06 user nova-compute[74482]:   </os>
Oct 23 23:01:06 user nova-compute[74482]:   <features>
Oct 23 23:01:06 user nova-compute[74482]:     <acpi/>
Oct 23 23:01:06 user nova-compute[74482]:     <apic/>
Oct 23 23:01:06 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:01:06 user nova-compute[74482]:   </features>
Oct 23 23:01:06 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:01:06 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:01:06 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:01:06 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:01:06 user nova-compute[74482]:   </clock>
Oct 23 23:01:06 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:01:06 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:01:06 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:01:06 user nova-compute[74482]:   </cpu>
Oct 23 23:01:06 user nova-compute[74482]:   <devices>
Oct 23 23:01:06 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:01:06 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:01:06 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue"/>
Oct 23 23:01:06 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:01:06 user nova-compute[74482]:     </disk>
Oct 23 23:01:06 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:01:06 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:01:06 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk"/>
Oct 23 23:01:06 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:01:06 user nova-compute[74482]:     </disk>
Oct 23 23:01:06 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:01:06 user nova-compute[74482]:       <mac address="fa:16:3e:ec:09:58"/>
Oct 23 23:01:06 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:01:06 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:01:06 user nova-compute[74482]:       <target dev="tapd778946c-65"/>
Oct 23 23:01:06 user nova-compute[74482]:     </interface>
Oct 23 23:01:06 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:01:06 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/console.log" append="off"/>
Oct 23 23:01:06 user nova-compute[74482]:     </serial>
Oct 23 23:01:06 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:01:06 user nova-compute[74482]:     <video>
Oct 23 23:01:06 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:01:06 user nova-compute[74482]:     </video>
Oct 23 23:01:06 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:01:06 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:01:06 user nova-compute[74482]:     </rng>
Oct 23 23:01:06 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:01:06 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:01:06 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:01:06 user nova-compute[74482]:     </memballoon>
Oct 23 23:01:06 user nova-compute[74482]:   </devices>
Oct 23 23:01:06 user nova-compute[74482]: </domain>
Oct 23 23:01:06 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json -f qcow2 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Instance destroyed successfully.
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No VIF found with MAC fa:16:3e:ec:09:58, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-unplugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] No waiting events found dispatching network-vif-unplugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:01:06 user nova-compute[74482]: WARNING nova.compute.manager [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received unexpected event network-vif-unplugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 for instance with vm_state active and task_state rescuing.
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] No waiting events found dispatching network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:01:06 user nova-compute[74482]: WARNING nova.compute.manager [req-28bb4647-cdfa-4cc2-a3cd-0f6fa7525a4a req-4458774d-b40c-43bd-8f61-92016244cad1 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received unexpected event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 for instance with vm_state active and task_state rescuing.
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json -f qcow2" returned: 0 in 0.249s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json -f qcow2 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.204s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9sx9zujg/71e698db2b15435c86797b8a56ae7b5c.delta 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG nova.network.neutron [req-893594ed-d106-4269-b599-9da42963f229 req-f6b992a6-b100-451f-9b44-a568bf94b2c9 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updated VIF entry in instance network info cache for port c4bb13fd-216f-4510-91df-11b772b3b71e. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG nova.network.neutron [req-893594ed-d106-4269-b599-9da42963f229 req-f6b992a6-b100-451f-9b44-a568bf94b2c9 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updating instance_info_cache with network_info: [{"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9sx9zujg/71e698db2b15435c86797b8a56ae7b5c.delta 1073741824" returned: 0 in 0.051s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:07 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-893594ed-d106-4269-b599-9da42963f229 req-f6b992a6-b100-451f-9b44-a568bf94b2c9 service nova] Releasing lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance_info_cache with network_info: [{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:01:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Snapshot image upload complete
Oct 23 23:01:08 user nova-compute[74482]: INFO nova.compute.manager [None req-384ae76a-f49c-4678-9bac-4bdd6d4d051f tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Took 6.26 seconds to snapshot the instance on the hypervisor.
Oct 23 23:01:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:01:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:01:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 23:01:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-bc89063c-ab26-4f0d-b1c5-f27818972dd1 req-36f62523-7056-4e0c-9fd2-646c5ca4cd23 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bc89063c-ab26-4f0d-b1c5-f27818972dd1 req-36f62523-7056-4e0c-9fd2-646c5ca4cd23 service nova] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bc89063c-ab26-4f0d-b1c5-f27818972dd1 req-36f62523-7056-4e0c-9fd2-646c5ca4cd23 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bc89063c-ab26-4f0d-b1c5-f27818972dd1 req-36f62523-7056-4e0c-9fd2-646c5ca4cd23 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-bc89063c-ab26-4f0d-b1c5-f27818972dd1 req-36f62523-7056-4e0c-9fd2-646c5ca4cd23 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] No waiting events found dispatching network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:01:09 user nova-compute[74482]: WARNING nova.compute.manager [req-bc89063c-ab26-4f0d-b1c5-f27818972dd1 req-36f62523-7056-4e0c-9fd2-646c5ca4cd23 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received unexpected event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 for instance with vm_state active and task_state rescuing.
Oct 23 23:01:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:09 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:01:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9sx9zujg/71e698db2b15435c86797b8a56ae7b5c.delta /opt/stack/data/nova/instances/snapshots/tmp9sx9zujg/71e698db2b15435c86797b8a56ae7b5c {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9sx9zujg/71e698db2b15435c86797b8a56ae7b5c.delta /opt/stack/data/nova/instances/snapshots/tmp9sx9zujg/71e698db2b15435c86797b8a56ae7b5c" returned: 0 in 0.239s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Snapshot extracted, beginning image upload
Oct 23 23:01:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-c789056f-12ac-4640-b74c-6daa736705ce req-7f3e8798-dd5f-47db-a9af-bd6d9fa81911 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c789056f-12ac-4640-b74c-6daa736705ce req-7f3e8798-dd5f-47db-a9af-bd6d9fa81911 service nova] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c789056f-12ac-4640-b74c-6daa736705ce req-7f3e8798-dd5f-47db-a9af-bd6d9fa81911 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c789056f-12ac-4640-b74c-6daa736705ce req-7f3e8798-dd5f-47db-a9af-bd6d9fa81911 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-c789056f-12ac-4640-b74c-6daa736705ce req-7f3e8798-dd5f-47db-a9af-bd6d9fa81911 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] No waiting events found dispatching network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:01:11 user nova-compute[74482]: WARNING nova.compute.manager [req-c789056f-12ac-4640-b74c-6daa736705ce req-7f3e8798-dd5f-47db-a9af-bd6d9fa81911 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received unexpected event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 for instance with vm_state active and task_state rescuing.
Oct 23 23:01:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-190fafb6-07f6-4c1c-b3da-7e7ef06f6922 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:12 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Snapshot image upload complete
Oct 23 23:01:12 user nova-compute[74482]: INFO nova.compute.manager [None req-7d69ca43-2405-468b-986b-ac8035bd2928 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Took 6.51 seconds to snapshot the instance on the hypervisor.
Oct 23 23:01:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:15 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:01:15 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:01:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7291MB free_disk=25.347991943359375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:01:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa063829-b117-40f4-93f2-358b33f1d156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 3357081e-0244-4351-8ad9-ac87685f5832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 903923e6-8faa-4c46-9b5f-1b611f6902dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:01:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-cad78c04-a3f6-4052-8322-df5e4b356445 req-14ec7a22-bf90-43ba-a69c-0bea3362b7e0 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received event network-changed-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-cad78c04-a3f6-4052-8322-df5e4b356445 req-14ec7a22-bf90-43ba-a69c-0bea3362b7e0 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Refreshing instance network info cache due to event network-changed-e036d709-8377-45a6-a582-40ef5b175852. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cad78c04-a3f6-4052-8322-df5e4b356445 req-14ec7a22-bf90-43ba-a69c-0bea3362b7e0 service nova] Acquiring lock "refresh_cache-3357081e-0244-4351-8ad9-ac87685f5832" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cad78c04-a3f6-4052-8322-df5e4b356445 req-14ec7a22-bf90-43ba-a69c-0bea3362b7e0 service nova] Acquired lock "refresh_cache-3357081e-0244-4351-8ad9-ac87685f5832" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:25 user nova-compute[74482]: DEBUG nova.network.neutron [req-cad78c04-a3f6-4052-8322-df5e4b356445 req-14ec7a22-bf90-43ba-a69c-0bea3362b7e0 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Refreshing network info cache for port e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:26 user nova-compute[74482]: DEBUG nova.network.neutron [req-cad78c04-a3f6-4052-8322-df5e4b356445 req-14ec7a22-bf90-43ba-a69c-0bea3362b7e0 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Updated VIF entry in instance network info cache for port e036d709-8377-45a6-a582-40ef5b175852. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:01:26 user nova-compute[74482]: DEBUG nova.network.neutron [req-cad78c04-a3f6-4052-8322-df5e4b356445 req-14ec7a22-bf90-43ba-a69c-0bea3362b7e0 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Updating instance_info_cache with network_info: [{"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cad78c04-a3f6-4052-8322-df5e4b356445 req-14ec7a22-bf90-43ba-a69c-0bea3362b7e0 service nova] Releasing lock "refresh_cache-3357081e-0244-4351-8ad9-ac87685f5832" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:01:30 user nova-compute[74482]: INFO nova.compute.claims [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Claim successful on node user
Oct 23 23:01:30 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:01:30 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:01:30 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:01:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:01:31 user nova-compute[74482]: INFO nova.virt.block_device [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Booting with volume e1860888-6ec1-4ae7-8efc-a19ae27eb455 at /dev/vda
Oct 23 23:01:31 user nova-compute[74482]: DEBUG nova.policy [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19312461863840a3958147887f6ed1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12a4631cefff4ab3a81dcaeab669a0f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:01:31 user nova-compute[74482]: DEBUG os_brick.utils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:01:31 user nova-compute[74482]: INFO oslo.privsep.daemon [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpb8x_uvuj/privsep.sock']
Oct 23 23:01:31 user sudo[86302]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpb8x_uvuj/privsep.sock
Oct 23 23:01:31 user sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 23:01:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:31 user nova-compute[74482]: DEBUG nova.objects.instance [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lazy-loading 'flavor' on Instance uuid 3357081e-0244-4351-8ad9-ac87685f5832 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:31 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully created port: 229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:01:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:31 user nova-compute[74482]: INFO nova.compute.manager [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Attaching volume 7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 to /dev/sdc
Oct 23 23:01:31 user nova-compute[74482]: DEBUG os_brick.utils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:01:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:32 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully created port: 2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:01:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:32 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully created port: 790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:01:32 user sudo[86302]: pam_unix(sudo:session): session closed for user root
Oct 23 23:01:32 user nova-compute[74482]: INFO oslo.privsep.daemon [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Spawned new privsep daemon via rootwrap
Oct 23 23:01:32 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 23:01:32 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 23:01:32 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 23 23:01:32 user nova-compute[74482]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86306
Oct 23 23:01:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b5eee0-2045-4d79-ac08-1994309ed39b]: (2,) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:32 user nova-compute[74482]: WARNING oslo_privsep.priv_context [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] privsep daemon already running
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fefb7e6-5832-44ce-aff0-d22e666a0ce3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68effed-2d43-4038-a6c7-9d943924c21f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: WARNING os_brick.initiator.connectors.nvmeof [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7c60cd-f318-4f9b-aa2a-f37d7dbeb276]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c5d417-20b6-46fb-a174-2362975815b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec2136-9982-408e-89f4-d8906fe8b2af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[63017693-51e3-4ece-8dee-8b4d05ce14b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34a50cc-ae7f-4771-9d58-3695783a0646]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665bb9d-d7be-41ca-a201-a91c401cb114]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:33 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43ae0eb-7aa3-4f9b-bf38-041c4ddeaaca]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.utils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] <== get_connector_properties: return (1355ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Updating existing volume attachment record: acf8304f-483d-4c35-955e-9eb6c3078c02 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:33 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:01:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c4934a-ed2f-4221-b9b9-1e292369da9c]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG os_brick.utils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] <== get_connector_properties: return (2133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating existing volume attachment record: 0200bb5a-e671-4409-8243-8d60482587f7 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:01:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully created port: 9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:01:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully created port: 94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:01:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully updated port: 229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:01:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-d02f7f54-1832-4860-a004-52236484f500 req-b44737dc-82db-4755-abf2-c5ded6cceb35 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-changed-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-d02f7f54-1832-4860-a004-52236484f500 req-b44737dc-82db-4755-abf2-c5ded6cceb35 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing instance network info cache due to event network-changed-229b40af-c026-4f7a-a07d-f852450c0713. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d02f7f54-1832-4860-a004-52236484f500 req-b44737dc-82db-4755-abf2-c5ded6cceb35 service nova] Acquiring lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d02f7f54-1832-4860-a004-52236484f500 req-b44737dc-82db-4755-abf2-c5ded6cceb35 service nova] Acquired lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:34 user nova-compute[74482]: DEBUG nova.network.neutron [req-d02f7f54-1832-4860-a004-52236484f500 req-b44737dc-82db-4755-abf2-c5ded6cceb35 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing network info cache for port 229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:34 user nova-compute[74482]: DEBUG nova.network.neutron [req-d02f7f54-1832-4860-a004-52236484f500 req-b44737dc-82db-4755-abf2-c5ded6cceb35 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:01:35 user nova-compute[74482]: DEBUG nova.network.neutron [req-d02f7f54-1832-4860-a004-52236484f500 req-b44737dc-82db-4755-abf2-c5ded6cceb35 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d02f7f54-1832-4860-a004-52236484f500 req-b44737dc-82db-4755-abf2-c5ded6cceb35 service nova] Releasing lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully updated port: 64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:01:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully updated port: 1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:01:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-changed-64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing instance network info cache due to event network-changed-64a8d2d7-d71f-490b-b790-dfdca8b496c7. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] Acquiring lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] Acquired lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:36 user nova-compute[74482]: DEBUG nova.network.neutron [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing network info cache for port 64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG nova.network.neutron [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG nova.network.neutron [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] Releasing lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG nova.compute.manager [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-changed-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG nova.compute.manager [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing instance network info cache due to event network-changed-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] Acquiring lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] Acquired lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG nova.network.neutron [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing network info cache for port 1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully updated port: 2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG nova.network.neutron [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG nova.network.neutron [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-55d8512e-d8a8-478a-bced-aa0f6e7f27d1 req-08bee5f1-6eea-4974-8cd8-f0eac786c1c0 service nova] Releasing lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:38 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully updated port: 790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:01:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-a2b24b22-d832-4614-9cc4-134657b127e0 req-08b73b35-b68b-4114-971f-abe7cc244d96 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-changed-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-a2b24b22-d832-4614-9cc4-134657b127e0 req-08b73b35-b68b-4114-971f-abe7cc244d96 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing instance network info cache due to event network-changed-790f6250-f4da-4645-b46e-abd17525e803. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a2b24b22-d832-4614-9cc4-134657b127e0 req-08b73b35-b68b-4114-971f-abe7cc244d96 service nova] Acquiring lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a2b24b22-d832-4614-9cc4-134657b127e0 req-08b73b35-b68b-4114-971f-abe7cc244d96 service nova] Acquired lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:38 user nova-compute[74482]: DEBUG nova.network.neutron [req-a2b24b22-d832-4614-9cc4-134657b127e0 req-08b73b35-b68b-4114-971f-abe7cc244d96 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing network info cache for port 790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:38 user nova-compute[74482]: DEBUG nova.network.neutron [req-a2b24b22-d832-4614-9cc4-134657b127e0 req-08b73b35-b68b-4114-971f-abe7cc244d96 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-24ab75e5-9c68-4d3f-a9d1-885f6f0a86ef req-5cae9fbd-4d41-4aaa-a5fb-02f4542e8741 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-changed-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-24ab75e5-9c68-4d3f-a9d1-885f6f0a86ef req-5cae9fbd-4d41-4aaa-a5fb-02f4542e8741 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing instance network info cache due to event network-changed-2bd68230-dccb-4d57-ae57-a5799925a6fc. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-24ab75e5-9c68-4d3f-a9d1-885f6f0a86ef req-5cae9fbd-4d41-4aaa-a5fb-02f4542e8741 service nova] Acquiring lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.network.neutron [req-a2b24b22-d832-4614-9cc4-134657b127e0 req-08b73b35-b68b-4114-971f-abe7cc244d96 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a2b24b22-d832-4614-9cc4-134657b127e0 req-08b73b35-b68b-4114-971f-abe7cc244d96 service nova] Releasing lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-24ab75e5-9c68-4d3f-a9d1-885f6f0a86ef req-5cae9fbd-4d41-4aaa-a5fb-02f4542e8741 service nova] Acquired lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.network.neutron [req-24ab75e5-9c68-4d3f-a9d1-885f6f0a86ef req-5cae9fbd-4d41-4aaa-a5fb-02f4542e8741 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing network info cache for port 2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.network.neutron [req-24ab75e5-9c68-4d3f-a9d1-885f6f0a86ef req-5cae9fbd-4d41-4aaa-a5fb-02f4542e8741 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.network.neutron [req-24ab75e5-9c68-4d3f-a9d1-885f6f0a86ef req-5cae9fbd-4d41-4aaa-a5fb-02f4542e8741 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-24ab75e5-9c68-4d3f-a9d1-885f6f0a86ef req-5cae9fbd-4d41-4aaa-a5fb-02f4542e8741 service nova] Releasing lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully updated port: 9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-8422c63c-5ea3-4ea1-9ffb-e9e36ec198d6 req-5a696e85-4095-4eaf-beb3-52122bf3bea7 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received event network-changed-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-8422c63c-5ea3-4ea1-9ffb-e9e36ec198d6 req-5a696e85-4095-4eaf-beb3-52122bf3bea7 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Refreshing instance network info cache due to event network-changed-01bf792d-71d9-4ebb-822a-b3ed3b696af2. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8422c63c-5ea3-4ea1-9ffb-e9e36ec198d6 req-5a696e85-4095-4eaf-beb3-52122bf3bea7 service nova] Acquiring lock "refresh_cache-e8bdfd0e-24d2-4f31-a650-60edac47fc97" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8422c63c-5ea3-4ea1-9ffb-e9e36ec198d6 req-5a696e85-4095-4eaf-beb3-52122bf3bea7 service nova] Acquired lock "refresh_cache-e8bdfd0e-24d2-4f31-a650-60edac47fc97" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.network.neutron [req-8422c63c-5ea3-4ea1-9ffb-e9e36ec198d6 req-5a696e85-4095-4eaf-beb3-52122bf3bea7 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Refreshing network info cache for port 01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:39 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lazy-loading 'flavor' on Instance uuid e8bdfd0e-24d2-4f31-a650-60edac47fc97 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG nova.network.neutron [req-8422c63c-5ea3-4ea1-9ffb-e9e36ec198d6 req-5a696e85-4095-4eaf-beb3-52122bf3bea7 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Updated VIF entry in instance network info cache for port 01bf792d-71d9-4ebb-822a-b3ed3b696af2. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG nova.network.neutron [req-8422c63c-5ea3-4ea1-9ffb-e9e36ec198d6 req-5a696e85-4095-4eaf-beb3-52122bf3bea7 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Updating instance_info_cache with network_info: [{"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:40 user nova-compute[74482]: INFO nova.compute.manager [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Attaching volume 9e098ec9-c890-45b4-8dbb-3eb0126d9d7e to /dev/vdb
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8422c63c-5ea3-4ea1-9ffb-e9e36ec198d6 req-5a696e85-4095-4eaf-beb3-52122bf3bea7 service nova] Releasing lock "refresh_cache-e8bdfd0e-24d2-4f31-a650-60edac47fc97" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG os_brick.utils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[afafde20-5574-4843-91c4-f29a142907fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6918494-8a8a-4b60-bf10-98379f22ab69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[548bb458-1502-45de-91b4-f23526c845a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa32ab7e-18a4-46ed-9bb2-ae8012517e2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:40 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eec6d4-a7e1-4b5f-9435-1d0deb57aa96]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG os_brick.utils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Updating existing volume attachment record: 0b46ba62-4bbe-4a1b-913f-9246ae801b31 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Successfully updated port: 94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquired lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-changed-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing instance network info cache due to event network-changed-9a33e15e-c112-43ba-92be-faed55a7c76c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] Acquiring lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:42 user nova-compute[74482]: DEBUG nova.network.neutron [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Releasing lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:42 user nova-compute[74482]: DEBUG nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance network_info: |[{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:01:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] Acquired lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:42 user nova-compute[74482]: DEBUG nova.network.neutron [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing network info cache for port 9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updated VIF entry in instance network info cache for port 9a33e15e-c112-43ba-92be-faed55a7c76c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:01:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] Releasing lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-changed-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing instance network info cache due to event network-changed-94afaf97-3346-4e42-9201-65840d08a317. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] Acquiring lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] Acquired lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing network info cache for port 94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:44 user nova-compute[74482]: DEBUG nova.network.neutron [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updated VIF entry in instance network info cache for port 94afaf97-3346-4e42-9201-65840d08a317. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:01:44 user nova-compute[74482]: DEBUG nova.network.neutron [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5a92fb89-38a6-43c7-8151-329ce45f3fd3 req-b647f7a5-a460-49a9-afd9-b4fc44817d5e service nova] Releasing lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-2b2b9733-c82d-4cb8-9c2a-9a1e7bdf673e req-91d6e2b0-caf5-4e3e-b886-34014c5f418e service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received event network-changed-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:01:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-2b2b9733-c82d-4cb8-9c2a-9a1e7bdf673e req-91d6e2b0-caf5-4e3e-b886-34014c5f418e service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Refreshing instance network info cache due to event network-changed-4d273b5c-85c1-42f9-b31a-321932d97e42. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:01:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2b2b9733-c82d-4cb8-9c2a-9a1e7bdf673e req-91d6e2b0-caf5-4e3e-b886-34014c5f418e service nova] Acquiring lock "refresh_cache-903923e6-8faa-4c46-9b5f-1b611f6902dc" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:01:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2b2b9733-c82d-4cb8-9c2a-9a1e7bdf673e req-91d6e2b0-caf5-4e3e-b886-34014c5f418e service nova] Acquired lock "refresh_cache-903923e6-8faa-4c46-9b5f-1b611f6902dc" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:01:44 user nova-compute[74482]: DEBUG nova.network.neutron [req-2b2b9733-c82d-4cb8-9c2a-9a1e7bdf673e req-91d6e2b0-caf5-4e3e-b886-34014c5f418e service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Refreshing network info cache for port 4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:01:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-2b2b9733-c82d-4cb8-9c2a-9a1e7bdf673e req-91d6e2b0-caf5-4e3e-b886-34014c5f418e service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Updated VIF entry in instance network info cache for port 4d273b5c-85c1-42f9-b31a-321932d97e42. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:01:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-2b2b9733-c82d-4cb8-9c2a-9a1e7bdf673e req-91d6e2b0-caf5-4e3e-b886-34014c5f418e service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Updating instance_info_cache with network_info: [{"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:01:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2b2b9733-c82d-4cb8-9c2a-9a1e7bdf673e req-91d6e2b0-caf5-4e3e-b886-34014c5f418e service nova] Releasing lock "refresh_cache-903923e6-8faa-4c46-9b5f-1b611f6902dc" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:01:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connector [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Factory for ISCSI on None {{(pid=74482) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbLeTPOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:01:52 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:01:52 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:01:52 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5988753f-12f2-4d4c-bef9-242d949c0efa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:01:52 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9212bc4a-3f85-4b3d-8f81-7d29c36e43f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82] added
Oct 23 23:01:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d363236d-1bd6-425c-acd5-50d5e42bcc47]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[334226da-3e0e-4c94-8de7-e84f6fa00ef5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbLeTPOf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbLeTPOf" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e91a7d-0e39-4388-a31c-de3432de5152]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WbLeTPOf'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4ea3fb-8a35-4cb9-a4b9-28f0905a28a7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d560a-2eca-4d4f-a604-82337c79ffc3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:01:52 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:01:52 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:01:52 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:01:52 user nova-compute[74482]: 
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8c00d3-5c63-4929-8d06-3cfdf3544794]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82, portal: 172.16.0.220,3260]
Oct 23 23:01:52 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82, portal: 172.16.0.220,3260] successful.
Oct 23 23:01:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:01:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5208a4-4279-4eea-90b7-c73792319bd2]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c7c954-1e35-48a8-8152-daab54c82f59]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:01:53 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:01:53 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lazy-loading 'flavor' on Instance uuid 903923e6-8faa-4c46-9b5f-1b611f6902dc {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bedf872-0fe8-4752-ad07-71d2b055078c]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbLeTPOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:01:53 user nova-compute[74482]: INFO nova.virt.block_device [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Booting with volume d66b2221-0469-4917-a502-20c0d3c8f1a7 at /dev/vdb
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.utils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc4876a-1a52-4000-a52f-297fe3f8cfed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae6bfa0-e939-46df-87b0-729c6b5195bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea683f54-6a9a-470b-9ee6-a1a2f567694f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75320a3-3ab0-4243-a663-52102ec28b5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:01:53 user nova-compute[74482]: INFO nova.compute.manager [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Attaching volume 63c27ba4-0456-45eb-bc43-dc992ebef1f9 to /dev/vdb
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:53 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b98ed4-d984-41d6-ad77-b63a58b1fd71]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.utils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating existing volume attachment record: b1b033e8-631b-4e54-9013-3a504234ba6f {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.utils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90819cfc-b102-44d8-bada-f297f762cdcb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e6cdda-d6e9-4ebe-b3c5-a5ff008e281b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f7b09e-c230-4834-9fc2-b112fa57d2e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbb2cdc-1604-4a97-81da-9aa09fe95d50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:01:53 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:01:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c111c75d-5707-44d8-9cf2-a039a862b7cf]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG os_brick.utils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:01:53 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Updating existing volume attachment record: 5864e4a1-0ad4-495f-bad2-d3e32a618434 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:01:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:01:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26639616236393465', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:01:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639616236393465', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:01:54 user nova-compute[74482]: DEBUG nova.objects.instance [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lazy-loading 'flavor' on Instance uuid 3357081e-0244-4351-8ad9-ac87685f5832 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:01:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:01:54 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:01:54 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:01:54 user nova-compute[74482]:   <target dev="sdc" bus="scsi"/>
Oct 23 23:01:54 user nova-compute[74482]:   <serial>7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82</serial>
Oct 23 23:01:54 user nova-compute[74482]:   <address type="drive" controller="0" unit="2"/>
Oct 23 23:01:54 user nova-compute[74482]: </disk>
Oct 23 23:01:54 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:01:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] No BDM found with device name sda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:01:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:01:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:01:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] No VIF found with MAC fa:16:3e:1a:8b:cd, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:01:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:01:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:02:10 user nova-compute[74482]: INFO nova.compute.claims [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Claim successful on node user
Oct 23 23:02:10 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:02:10 user nova-compute[74482]: DEBUG nova.network.neutron [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:02:10 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:02:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG nova.policy [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebd17d342e7145e0bad04188ec8be780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981f084ec65e4fa0a9cbd2e5edf8302a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:02:11 user nova-compute[74482]: INFO nova.virt.block_device [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Booting with blank volume at /dev/vda
Oct 23 23:02:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmUdInSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:11 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:11 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:11 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d06a3-e9fa-42fb-8f73-eef80ef7ec1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:02:11 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b669986-952a-477c-8225-446b4fd0ef69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9] added
Oct 23 23:02:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbc0c36-fcee-4225-9663-e8debc27b768]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ef612c-4ec1-4b64-9256-2cb411a98df7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmUdInSP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmUdInSP" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b66e9bf-0908-4248-b30a-b395dd79e7c3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmUdInSP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968f4a2f-9903-46c9-b74e-cd037bb6c5d1 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.495s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[08df4347-960f-4afd-9402-cc7ea429a482]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a09f01-b6a2-4696-b6a5-1199240c571a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee22d43f-c16d-41b9-855f-16e6c08bd48d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9, portal: 172.16.0.220,3260]
Oct 23 23:02:11 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: INFO nova.virt.block_device [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Booting with volume e1365030-012b-4dde-9785-9b399480f9fe at /dev/vdc
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c68b69b-afbd-4ec0-8725-fbe4822b80c9]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8adf06-13bb-47ea-b898-25438faf5616]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:11 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:11 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebed658-d77b-451e-a0d1-fe54268ba6f3]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmUdInSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.utils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47d15e9-a618-4e1a-8d3b-5f56656489ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG nova.network.neutron [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Successfully created port: 9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cb75a0-8de0-491f-8a45-9926cc251b33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d0f4b5-9258-47da-8926-f3c6aba84ffd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c440d-acfe-4520-af34-fa06249cf599]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:11 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:02:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[030a7c01-f679-4406-818c-9486681039af]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG os_brick.utils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:11 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating existing volume attachment record: 6951926b-bfe3-41f7-b8f2-4e78d7a345de {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.network.neutron [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Successfully updated port: 9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquired lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.network.neutron [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-6a02f8a1-411e-4fe1-b548-e74216b06910 req-0bb94102-9173-421d-a8cf-3f7c4fbba1ca service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-changed-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-6a02f8a1-411e-4fe1-b548-e74216b06910 req-0bb94102-9173-421d-a8cf-3f7c4fbba1ca service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Refreshing instance network info cache due to event network-changed-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6a02f8a1-411e-4fe1-b548-e74216b06910 req-0bb94102-9173-421d-a8cf-3f7c4fbba1ca service nova] Acquiring lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.network.neutron [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26466613239383431', 'path': '/dev/sdc'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466613239383431', 'path': '/dev/sdc'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lazy-loading 'flavor' on Instance uuid 903923e6-8faa-4c46-9b5f-1b611f6902dc {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] attach device xml: <disk type="block" device="disk">
Oct 23 23:02:12 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:12 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:02:12 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:02:12 user nova-compute[74482]:   <serial>63c27ba4-0456-45eb-bc43-dc992ebef1f9</serial>
Oct 23 23:02:12 user nova-compute[74482]: </disk>
Oct 23 23:02:12 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.network.neutron [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updating instance_info_cache with network_info: [{"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Releasing lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Instance network_info: |[{"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6a02f8a1-411e-4fe1-b548-e74216b06910 req-0bb94102-9173-421d-a8cf-3f7c4fbba1ca service nova] Acquired lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:02:12 user nova-compute[74482]: DEBUG nova.network.neutron [req-6a02f8a1-411e-4fe1-b548-e74216b06910 req-0bb94102-9173-421d-a8cf-3f7c4fbba1ca service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Refreshing network info cache for port 9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:13 user nova-compute[74482]: INFO nova.compute.manager [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Detaching volume 7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] No VIF found with MAC fa:16:3e:7a:9c:23, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:02:13 user nova-compute[74482]: INFO nova.virt.block_device [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Attempting to driver detach volume 7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 from mountpoint /dev/sdc
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Attempting to detach device sdc from instance 3357081e-0244-4351-8ad9-ac87685f5832 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:02:13 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:13 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:02:13 user nova-compute[74482]:   <target dev="sdc" bus="scsi"/>
Oct 23 23:02:13 user nova-compute[74482]:   <serial>7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82</serial>
Oct 23 23:02:13 user nova-compute[74482]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 23 23:02:13 user nova-compute[74482]: </disk>
Oct 23 23:02:13 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.network.neutron [req-6a02f8a1-411e-4fe1-b548-e74216b06910 req-0bb94102-9173-421d-a8cf-3f7c4fbba1ca service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updated VIF entry in instance network info cache for port 9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.network.neutron [req-6a02f8a1-411e-4fe1-b548-e74216b06910 req-0bb94102-9173-421d-a8cf-3f7c4fbba1ca service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updating instance_info_cache with network_info: [{"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:02:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Successfully detached device sdc from instance 3357081e-0244-4351-8ad9-ac87685f5832 from the persistent domain config.
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 3357081e-0244-4351-8ad9-ac87685f5832 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:02:13 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:13 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:02:13 user nova-compute[74482]:   <target dev="sdc" bus="scsi"/>
Oct 23 23:02:13 user nova-compute[74482]:   <serial>7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82</serial>
Oct 23 23:02:13 user nova-compute[74482]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 23 23:02:13 user nova-compute[74482]: </disk>
Oct 23 23:02:13 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6a02f8a1-411e-4fe1-b548-e74216b06910 req-0bb94102-9173-421d-a8cf-3f7c4fbba1ca service nova] Releasing lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7ffddb99-9ade-446c-b3f0-864062df6223 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.039s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 3357081e-0244-4351-8ad9-ac87685f5832 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4b2b5507-0a52-441d-8961-6e3e4b48a2ac tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] volume_snapshot_create: create_info: {'snapshot_id': 'd072fe28-b7e3-46c3-9c53-ed961be7b75b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74482) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4b2b5507-0a52-441d-8961-6e3e4b48a2ac tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] snap xml: <domainsnapshot>
Oct 23 23:02:13 user nova-compute[74482]:   <disks>
Oct 23 23:02:13 user nova-compute[74482]:     <disk name="/dev/sdc" snapshot="external" type="file">
Oct 23 23:02:13 user nova-compute[74482]:       <source file="/dev/new_file"/>
Oct 23 23:02:13 user nova-compute[74482]:     </disk>
Oct 23 23:02:13 user nova-compute[74482]:     <disk name="vda" snapshot="no"/>
Oct 23 23:02:13 user nova-compute[74482]:   </disks>
Oct 23 23:02:13 user nova-compute[74482]: </domainsnapshot>
Oct 23 23:02:13 user nova-compute[74482]:  {{(pid=74482) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4b2b5507-0a52-441d-8961-6e3e4b48a2ac tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] Lazy-loading 'system_metadata' on Instance uuid 903923e6-8faa-4c46-9b5f-1b611f6902dc {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d4255a24-2d51-407b-a76e-1d72896a2ce9 tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] volume_snapshot_delete: delete_info: {'volume_id': '63c27ba4-0456-45eb-bc43-dc992ebef1f9'} {{(pid=74482) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 23 23:02:13 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [None req-d4255a24-2d51-407b-a76e-1d72896a2ce9 tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 23 23:02:13 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Traceback (most recent call last):
Oct 23 23:02:13 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 23:02:13 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 23:02:13 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 23:02:13 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     if delete_info['type'] != 'qcow2':
Oct 23 23:02:13 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] KeyError: 'type'
Oct 23 23:02:13 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] 
Oct 23 23:02:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4b2b5507-0a52-441d-8961-6e3e4b48a2ac tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [None req-4b2b5507-0a52-441d-8961-6e3e4b48a2ac tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     rv = execute(f, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     six.reraise(c, e, tb)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     raise value
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     rv = meth(*args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [None req-4b2b5507-0a52-441d-8961-6e3e4b48a2ac tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     self._volume_snapshot_create(context, instance, guest,
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     rv = execute(f, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     six.reraise(c, e, tb)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     raise value
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     rv = meth(*args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [None req-d4255a24-2d51-407b-a76e-1d72896a2ce9 tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-3fd743d0-a4ee-47e0-977e-0c05e2595793)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server [None req-d4255a24-2d51-407b-a76e-1d72896a2ce9 tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] Exception during message handling: KeyError: 'type'
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver [None req-4b2b5507-0a52-441d-8961-6e3e4b48a2ac tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot d072fe28-b7e3-46c3-9c53-ed961be7b75b could not be found.
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     raise value
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot d072fe28-b7e3-46c3-9c53-ed961be7b75b could not be found. (HTTP 404) (Request-ID: req-14ce0ac1-3890-42e9-b9bd-42e4f80d4ecf)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot d072fe28-b7e3-46c3-9c53-ed961be7b75b could not be found.
Oct 23 23:02:14 user nova-compute[74482]: ERROR nova.virt.libvirt.driver 
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server [None req-4b2b5507-0a52-441d-8961-6e3e4b48a2ac tempest-VolumesAssistedSnapshotsTest-1486638453 tempest-VolumesAssistedSnapshotsTest-1486638453-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     raise value
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 23:02:14 user nova-compute[74482]: ERROR oslo_messaging.rpc.server 
Oct 23 23:02:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:14 user nova-compute[74482]: INFO nova.compute.manager [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Detaching volume 63c27ba4-0456-45eb-bc43-dc992ebef1f9
Oct 23 23:02:14 user nova-compute[74482]: INFO nova.virt.block_device [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Attempting to driver detach volume 63c27ba4-0456-45eb-bc43-dc992ebef1f9 from mountpoint /dev/vdb
Oct 23 23:02:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Attempting to detach device vdb from instance 903923e6-8faa-4c46-9b5f-1b611f6902dc from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:02:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] detach device xml: <disk type="block" device="disk">
Oct 23 23:02:14 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:14 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:02:14 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:02:14 user nova-compute[74482]:   <serial>63c27ba4-0456-45eb-bc43-dc992ebef1f9</serial>
Oct 23 23:02:14 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:02:14 user nova-compute[74482]: </disk>
Oct 23 23:02:14 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:02:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Successfully detached device vdb from instance 903923e6-8faa-4c46-9b5f-1b611f6902dc from the persistent domain config.
Oct 23 23:02:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 903923e6-8faa-4c46-9b5f-1b611f6902dc from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:02:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] detach device xml: <disk type="block" device="disk">
Oct 23 23:02:14 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:14 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:02:14 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:02:14 user nova-compute[74482]:   <serial>63c27ba4-0456-45eb-bc43-dc992ebef1f9</serial>
Oct 23 23:02:14 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:02:14 user nova-compute[74482]: </disk>
Oct 23 23:02:14 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:02:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 903923e6-8faa-4c46-9b5f-1b611f6902dc {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:02:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:02:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:02:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:02:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:02:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:02:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:02:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating instance_info_cache with network_info: [{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG os_brick.utils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3255769b-981e-49fb-91a0-66c72ed888be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e79933e-19c0-4fdd-92b3-2be8b99fca1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4efc1b3-8e83-4a1a-8d83-317ba1bcc056]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaeb8cc-823a-4047-a172-5eef6c8e4040]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:17 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[910839cd-353a-46dd-9e1b-e3186fad0931]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG os_brick.utils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updating existing volume attachment record: 80e94649-c36a-402b-94d1-1ba7470b0c48 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIMeiUcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:20 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:20 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:20 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59f2c12-4f2a-4cf8-bd99-7ddecc3a3605]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:02:20 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c809f992-fc28-45a4-a68b-269fce3c9f07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e] added
Oct 23 23:02:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b498900-4fb6-4640-aca1-096685cb1864]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4689683e-17db-4662-8e46-e4f7bf5abf5a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIMeiUcp {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIMeiUcp" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[79436203-a20c-4867-919d-f93bc04b4f59]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XIMeiUcp'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbfa4ca-020d-47cc-98f5-818ca629c2d4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[56db0130-bbb7-44fe-8cc4-a42798488601]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:20 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:20 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b2aa94-b54f-41b9-b3e3-a3c0ca0fd0f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260]
Oct 23 23:02:20 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a707f3d-858e-4fde-b694-e456463c4184]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[79923845-c1da-4b90-98cd-afabb5f9b385]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:20 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:20 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:20 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:20 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aed806f-1477-4c6c-ac04-da38af9dc804]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIMeiUcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:02:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7509MB free_disk=25.2998046875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23263643933303833', 'path': '/dev/sdd'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263643933303833', 'path': '/dev/sdd'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lazy-loading 'flavor' on Instance uuid e8bdfd0e-24d2-4f31-a650-60edac47fc97 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:02:21 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:21 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:02:21 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:02:21 user nova-compute[74482]:   <serial>9e098ec9-c890-45b4-8dbb-3eb0126d9d7e</serial>
Oct 23 23:02:21 user nova-compute[74482]: </disk>
Oct 23 23:02:21 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa063829-b117-40f4-93f2-358b33f1d156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 3357081e-0244-4351-8ad9-ac87685f5832 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 903923e6-8faa-4c46-9b5f-1b611f6902dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4f8e4516-738d-4440-938e-88ede5fe7b31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:02:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] No VIF found with MAC fa:16:3e:e4:23:61, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1381c111-ed42-43ba-8f0e-7820c492b889 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.221s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG os_brick.utils [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[25925e78-0b40-42b7-b526-00471e80ccb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec0fe6d-2941-4051-8a17-36ee9a1ab803]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff5472d-2b7e-41e8-9b8b-aff95bc500d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[582ef7c9-6512-4ba9-96ce-f45e6e396105]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:23 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:02:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6d66c5-b7ca-48f6-af21-dde42e916465]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:02:23 user nova-compute[74482]: DEBUG os_brick.utils [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:23 user nova-compute[74482]: INFO nova.compute.manager [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Swapping volume 9e098ec9-c890-45b4-8dbb-3eb0126d9d7e for 3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39
Oct 23 23:02:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:02:31 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Creating image(s)
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Ensure instance console log exists: /opt/stack/data/nova/instances/4f8e4516-738d-4440-938e-88ede5fe7b31/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Start _get_guest_xml network_info=[{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpsuDdNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f8e4516-738d-4440-938e-88ede5fe7b31', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1860888-6ec1-4ae7-8efc-a19ae27eb455', 'serial': 'e1860888-6ec1-4ae7-8efc-a19ae27eb455'}, 'disk_bus': 'virtio', 'attachment_id': '0200bb5a-e671-4409-8243-8d60482587f7', 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnfGpWVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f8e4516-738d-4440-938e-88ede5fe7b31', 'attached_at': '', 'detached_at': '', 'volume_id': 'd66b2221-0469-4917-a502-20c0d3c8f1a7', 'serial': 'd66b2221-0469-4917-a502-20c0d3c8f1a7'}, 'disk_bus': 'virtio', 'attachment_id': 'b1b033e8-631b-4e54-9013-3a504234ba6f', 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOcdobMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f8e4516-738d-4440-938e-88ede5fe7b31', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1365030-012b-4dde-9785-9b399480f9fe', 'serial': 'e1365030-012b-4dde-9785-9b399480f9fe'}, 'disk_bus': 'virtio', 'attachment_id': '6951926b-bfe3-41f7-b8f2-4e78d7a345de', 'boot_index': 2, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:02:31 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:02:31 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpsuDdNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:31 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:31 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:31 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddae4fc-d628-4539-806c-d4a7cb83e568]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:02:31 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8f9edd-1422-4ca9-b0f1-f10d4ed5205c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455] added
Oct 23 23:02:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a536ee8-b289-49e0-be6b-8afc6f4c963a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29fc19b-eef6-42d0-82c7-726d45c18475]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gpsuDdNm {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gpsuDdNm" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600c3fd-89c8-48ef-aa37-8b6b88d65428]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gpsuDdNm'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebdc54c-de47-48fa-98fe-e375ceb847e5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a416e3e-ebc8-4c09-b102-dcd859bbe750]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[594c4e4d-123a-4d6d-88e7-0673218919a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455, portal: 172.16.0.220,3260]
Oct 23 23:02:31 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[732e5553-bc80-4ab9-a71b-47def0c59170]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[052eb3ea-cc33-4f53-9fb4-17c6a9b8034b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:31 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bdf94b-e180-4ea9-868c-eb115e72db2a]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:02:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpsuDdNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:02:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:02:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:32 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:02:32 user nova-compute[74482]: INFO nova.compute.claims [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Claim successful on node user
Oct 23 23:02:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:32 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:02:32 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.697s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] <== connect_volume: return (1699ms) {'type': 'block', 'scsi_wwn': '23962393666333437', 'path': '/dev/sde'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962393666333437', 'path': '/dev/sde'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.837s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnfGpWVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:33 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:33 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:33 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdc0d38-e8d8-4d45-85b1-10bf708cee96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:02:33 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3d0960-be7e-4e91-bd5e-35ee3588a50d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7] added
Oct 23 23:02:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7ae6da-a408-4228-b6bd-18c3039171c4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809e97d-8c7b-4f67-96ed-47a38ae55f95]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnfGpWVX {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mnfGpWVX" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb6b2a9-7454-4154-bcec-36505153f57b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mnfGpWVX'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a1a5ff-924b-4674-89b1-9a3a50afbbd5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.policy [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '875daa8820804264a89ecfc2c6884fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a325a57cab5d4baea61d50a50d520b1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e766b40-d126-4013-a00b-eb2744a05570]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:02:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Creating image(s)
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "/opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "/opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "/opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[391531d2-6866-4ffe-9d11-70685079a776]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7, portal: 172.16.0.220,3260]
Oct 23 23:02:33 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6267dd5-1f75-48b3-9d8d-0d5de0136d51]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 3357081e-0244-4351-8ad9-ac87685f5832 is timed out.
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Successfully detached device sdc from instance 3357081e-0244-4351-8ad9-ac87685f5832 from the live domain config.
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbLeTPOf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:33 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[819e794e-943c-4bf7-b05d-e3ff349c2364]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c944a77-1399-4c02-97ae-e6a78902edbf]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnfGpWVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.211s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk 1073741824" returned: 0 in 0.059s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Successfully created port: 09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Cannot resize image /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Ensure instance console log exists: /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26632363133616165', 'path': '/dev/sdf'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632363133616165', 'path': '/dev/sdf'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.060s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOcdobMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:34 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52668522-408d-4fb5-b7f9-f20e63e4f23b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:02:34 user nova-compute[74482]: No targets found.
Oct 23 23:02:34 user nova-compute[74482]: iSNS:
Oct 23 23:02:34 user nova-compute[74482]: No targets found.
Oct 23 23:02:34 user nova-compute[74482]: STATIC:
Oct 23 23:02:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9
Oct 23 23:02:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e
Oct 23 23:02:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455
Oct 23 23:02:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7
Oct 23 23:02:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82
Oct 23 23:02:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:34 user nova-compute[74482]: FIRMWARE:
Oct 23 23:02:34 user nova-compute[74482]: No targets found.
Oct 23 23:02:34 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:02:34 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:02:34 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[16495ce6-227c-4ded-8ff2-d9356474fc58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Successfully updated port: 09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b682c0d-4ee6-4d36-9957-0858b097102d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:34 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:34 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:34 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:34 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:34 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 (non-flash)
Oct 23 23:02:34 user nova-compute[74482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:34 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:34 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:34 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:34 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f304c7c1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "refresh_cache-31c01877-ca5c-45cd-b85a-ec624b3e2a3f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquired lock "refresh_cache-31c01877-ca5c-45cd-b85a-ec624b3e2a3f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8368b1c7-a20e-41d8-a504-a7691af493a3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-1dc476af-dfd4-40fd-992a-0b67dc8bd612 req-3ab4bbf8-9247-40f4-a771-3939274c163f service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received event network-changed-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-1dc476af-dfd4-40fd-992a-0b67dc8bd612 req-3ab4bbf8-9247-40f4-a771-3939274c163f service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Refreshing instance network info cache due to event network-changed-09c150b3-181b-47ed-b0b0-964e8d60f2e0. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1dc476af-dfd4-40fd-992a-0b67dc8bd612 req-3ab4bbf8-9247-40f4-a771-3939274c163f service nova] Acquiring lock "refresh_cache-31c01877-ca5c-45cd-b85a-ec624b3e2a3f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af338dd-db4f-4667-9e1b-9ff8a2950aef]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e2708e-783d-45b3-ae72-4aca1a65a74a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:02:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[458f95aa-0416-4e41-bd9c-82db331ed318]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6695c030-3c3d-454c-aedc-b5126d835b3a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 903923e6-8faa-4c46-9b5f-1b611f6902dc is timed out.
Oct 23 23:02:35 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Successfully detached device vdb from instance 903923e6-8faa-4c46-9b5f-1b611f6902dc from the live domain config.
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmUdInSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:35 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee74603-2779-46a4-b533-f58903159052]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82, portal: 172.16.0.220,3260]
Oct 23 23:02:35 user nova-compute[74482]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7658a6ed-f75f-4cc1-b2d4-f079eb2d6b82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f21d337-d45c-499e-8fe3-4f6f2a55a83d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] <== disconnect_volume: return (1457ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.373s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:35 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:35 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01ba0b1-fb89-45e0-bf05-4f9e9c944d03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:02:35 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Updating instance_info_cache with network_info: [{"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[702011e6-21b5-4ee0-8892-a766f530a93d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe] added
Oct 23 23:02:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Releasing lock "refresh_cache-31c01877-ca5c-45cd-b85a-ec624b3e2a3f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Instance network_info: |[{"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1dc476af-dfd4-40fd-992a-0b67dc8bd612 req-3ab4bbf8-9247-40f4-a771-3939274c163f service nova] Acquired lock "refresh_cache-31c01877-ca5c-45cd-b85a-ec624b3e2a3f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.network.neutron [req-1dc476af-dfd4-40fd-992a-0b67dc8bd612 req-3ab4bbf8-9247-40f4-a771-3939274c163f service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Refreshing network info cache for port 09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Start _get_guest_xml network_info=[{"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:02:35 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:02:35 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1d6d6b-89e1-4970-baa2-bd5692288440]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-697166623',display_name='tempest-VolumesActionsTest-instance-697166623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-697166623',id=12,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a325a57cab5d4baea61d50a50d520b1c',ramdisk_id='',reservation_id='r-i0qjkglj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-732614350',owner_user_name='tempest-VolumesActionsTest-732614350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:02:34Z,user_data=None,user_id='875daa8820804264a89ecfc2c6884fa1',uuid=31c01877-ca5c-45cd-b85a-ec624b3e2a3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converting VIF {"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=09c150b3-181b-47ed-b0b0-964e8d60f2e0,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c150b3-18') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.objects.instance [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lazy-loading 'pci_devices' on Instance uuid 31c01877-ca5c-45cd-b85a-ec624b3e2a3f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1769ae79-d5d4-408f-9e51-c14c69ddd26b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pOcdobMj {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:02:35 user nova-compute[74482]:   <uuid>31c01877-ca5c-45cd-b85a-ec624b3e2a3f</uuid>
Oct 23 23:02:35 user nova-compute[74482]:   <name>instance-0000000c</name>
Oct 23 23:02:35 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:02:35 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:02:35 user nova-compute[74482]:   <metadata>
Oct 23 23:02:35 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:02:35 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:02:35 user nova-compute[74482]:       <nova:name>tempest-VolumesActionsTest-instance-697166623</nova:name>
Oct 23 23:02:35 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:02:35</nova:creationTime>
Oct 23 23:02:35 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:02:35 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:02:35 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:02:35 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:02:35 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:02:35 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:02:35 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:02:35 user nova-compute[74482]:       <nova:owner>
Oct 23 23:02:35 user nova-compute[74482]:         <nova:user uuid="875daa8820804264a89ecfc2c6884fa1">tempest-VolumesActionsTest-732614350-project-member</nova:user>
Oct 23 23:02:35 user nova-compute[74482]:         <nova:project uuid="a325a57cab5d4baea61d50a50d520b1c">tempest-VolumesActionsTest-732614350</nova:project>
Oct 23 23:02:35 user nova-compute[74482]:       </nova:owner>
Oct 23 23:02:35 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:02:35 user nova-compute[74482]:       <nova:ports>
Oct 23 23:02:35 user nova-compute[74482]:         <nova:port uuid="09c150b3-181b-47ed-b0b0-964e8d60f2e0">
Oct 23 23:02:35 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 23:02:35 user nova-compute[74482]:         </nova:port>
Oct 23 23:02:35 user nova-compute[74482]:       </nova:ports>
Oct 23 23:02:35 user nova-compute[74482]:     </nova:instance>
Oct 23 23:02:35 user nova-compute[74482]:   </metadata>
Oct 23 23:02:35 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:02:35 user nova-compute[74482]:     <system>
Oct 23 23:02:35 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:02:35 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:02:35 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:02:35 user nova-compute[74482]:       <entry name="serial">31c01877-ca5c-45cd-b85a-ec624b3e2a3f</entry>
Oct 23 23:02:35 user nova-compute[74482]:       <entry name="uuid">31c01877-ca5c-45cd-b85a-ec624b3e2a3f</entry>
Oct 23 23:02:35 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:02:35 user nova-compute[74482]:     </system>
Oct 23 23:02:35 user nova-compute[74482]:   </sysinfo>
Oct 23 23:02:35 user nova-compute[74482]:   <os>
Oct 23 23:02:35 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:02:35 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:02:35 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:02:35 user nova-compute[74482]:   </os>
Oct 23 23:02:35 user nova-compute[74482]:   <features>
Oct 23 23:02:35 user nova-compute[74482]:     <acpi/>
Oct 23 23:02:35 user nova-compute[74482]:     <apic/>
Oct 23 23:02:35 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:02:35 user nova-compute[74482]:   </features>
Oct 23 23:02:35 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:02:35 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:02:35 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:02:35 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:02:35 user nova-compute[74482]:   </clock>
Oct 23 23:02:35 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:02:35 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:02:35 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:02:35 user nova-compute[74482]:   </cpu>
Oct 23 23:02:35 user nova-compute[74482]:   <devices>
Oct 23 23:02:35 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:02:35 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:02:35 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk"/>
Oct 23 23:02:35 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:02:35 user nova-compute[74482]:     </disk>
Oct 23 23:02:35 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:02:35 user nova-compute[74482]:       <mac address="fa:16:3e:64:4f:87"/>
Oct 23 23:02:35 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:35 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:02:35 user nova-compute[74482]:       <target dev="tap09c150b3-18"/>
Oct 23 23:02:35 user nova-compute[74482]:     </interface>
Oct 23 23:02:35 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:02:35 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/console.log" append="off"/>
Oct 23 23:02:35 user nova-compute[74482]:     </serial>
Oct 23 23:02:35 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:02:35 user nova-compute[74482]:     <video>
Oct 23 23:02:35 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:35 user nova-compute[74482]:     </video>
Oct 23 23:02:35 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:02:35 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:02:35 user nova-compute[74482]:     </rng>
Oct 23 23:02:35 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:02:35 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:02:35 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:02:35 user nova-compute[74482]:     </memballoon>
Oct 23 23:02:35 user nova-compute[74482]:   </devices>
Oct 23 23:02:35 user nova-compute[74482]: </domain>
Oct 23 23:02:35 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-697166623',display_name='tempest-VolumesActionsTest-instance-697166623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-697166623',id=12,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a325a57cab5d4baea61d50a50d520b1c',ramdisk_id='',reservation_id='r-i0qjkglj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-732614350',owner_user_name='tempest-VolumesActionsTest-732614350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:02:34Z,user_data=None,user_id='875daa8820804264a89ecfc2c6884fa1',uuid=31c01877-ca5c-45cd-b85a-ec624b3e2a3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converting VIF {"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=09c150b3-181b-47ed-b0b0-964e8d60f2e0,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c150b3-18') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_vif [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=09c150b3-181b-47ed-b0b0-964e8d60f2e0,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c150b3-18') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb24f1c5-4d17-5783-947f-7413e1e9812d', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pOcdobMj" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa9e9f6-d6c0-41b8-9d9a-e33102d36d76]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pOcdobMj'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09c150b3-18, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09c150b3-18, col_values=(('qos', UUID('04b7e536-b5ff-4cd9-aba0-1808953c8133')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09c150b3-18, col_values=(('external_ids', {'iface-id': '09c150b3-181b-47ed-b0b0-964e8d60f2e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:4f:87', 'vm-uuid': '31c01877-ca5c-45cd-b85a-ec624b3e2a3f'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7785f5b-900c-4967-9576-ee3993d60d88]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:35 user nova-compute[74482]: INFO os_vif [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=09c150b3-181b-47ed-b0b0-964e8d60f2e0,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c150b3-18')
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b967396-33eb-4a3f-816b-ba095a4fe47c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] No VIF found with MAC fa:16:3e:64:4f:87, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d22bc8-8dbc-4f62-a810-2302647092a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe, portal: 172.16.0.220,3260]
Oct 23 23:02:35 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40445b9-493a-4cc5-bed5-969845f79085]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ea1da3-7f1f-46e5-9e58-d35406c5632c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:35 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc143e9-092f-48f1-bc80-c782d3f362b7]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOcdobMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.network.neutron [req-1dc476af-dfd4-40fd-992a-0b67dc8bd612 req-3ab4bbf8-9247-40f4-a771-3939274c163f service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Updated VIF entry in instance network info cache for port 09c150b3-181b-47ed-b0b0-964e8d60f2e0. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG nova.network.neutron [req-1dc476af-dfd4-40fd-992a-0b67dc8bd612 req-3ab4bbf8-9247-40f4-a771-3939274c163f service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Updating instance_info_cache with network_info: [{"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:02:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1dc476af-dfd4-40fd-992a-0b67dc8bd612 req-3ab4bbf8-9247-40f4-a771-3939274c163f service nova] Releasing lock "refresh_cache-31c01877-ca5c-45cd-b85a-ec624b3e2a3f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.objects.instance [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lazy-loading 'flavor' on Instance uuid 3357081e-0244-4351-8ad9-ac87685f5832 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-088bc1e8-72f6-437b-a180-74b9f1644f50 tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.188s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] <== connect_volume: return (1849ms) {'type': 'block', 'scsi_wwn': '23634303638336236', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634303638336236', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.586s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d335198-6817-4b97-b187-a3f99d9d65ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:02:36 user nova-compute[74482]: No targets found.
Oct 23 23:02:36 user nova-compute[74482]: iSNS:
Oct 23 23:02:36 user nova-compute[74482]: No targets found.
Oct 23 23:02:36 user nova-compute[74482]: STATIC:
Oct 23 23:02:36 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9
Oct 23 23:02:36 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:36 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:36 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e
Oct 23 23:02:36 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:36 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:36 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455
Oct 23 23:02:36 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:36 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:36 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7
Oct 23 23:02:36 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:36 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:36 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe
Oct 23 23:02:36 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:36 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:36 user nova-compute[74482]: FIRMWARE:
Oct 23 23:02:36 user nova-compute[74482]: No targets found.
Oct 23 23:02:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:02:36 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:02:36 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9e:c7,bridge_name='br-int',has_traffic_filtering=True,id=229b40af-c026-4f7a-a07d-f852450c0713,network=Network(56def97a-b5f4-4d08-9839-321a7f6669f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229b40af-c0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:68,bridge_name='br-int',has_traffic_filtering=True,id=64a8d2d7-d71f-490b-b790-dfdca8b496c7,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap64a8d2d7-d7') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e3efc9d-4f87-47c8-bdf6-f88cf14ba097,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3efc9d-4f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:1f:a6,bridge_name='br-int',has_traffic_filtering=True,id=2bd68230-dccb-4d57-ae57-a5799925a6fc,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd68230-dc') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:97:57,bridge_name='br-int',has_traffic_filtering=True,id=790f6250-f4da-4645-b46e-abd17525e803,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790f6250-f4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b1:59,bridge_name='br-int',has_traffic_filtering=True,id=9a33e15e-c112-43ba-92be-faed55a7c76c,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a33e15e-c1') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:df:c7,bridge_name='br-int',has_traffic_filtering=True,id=94afaf97-3346-4e42-9201-65840d08a317,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94afaf97-33') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.objects.instance [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f8e4516-738d-4440-938e-88ede5fe7b31 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c2a60d-b478-43f4-8ec5-06875c67fadd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:02:36 user nova-compute[74482]:   <uuid>4f8e4516-738d-4440-938e-88ede5fe7b31</uuid>
Oct 23 23:02:36 user nova-compute[74482]:   <name>instance-0000000a</name>
Oct 23 23:02:36 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:02:36 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:02:36 user nova-compute[74482]:   <metadata>
Oct 23 23:02:36 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:02:36 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:02:36 user nova-compute[74482]:       <nova:name>tempest-device-tagging-server-1293835838</nova:name>
Oct 23 23:02:36 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:02:31</nova:creationTime>
Oct 23 23:02:36 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:02:36 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:02:36 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:02:36 user nova-compute[74482]:       <nova:owner>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:user uuid="19312461863840a3958147887f6ed1e8">tempest-TaggedBootDevicesTest_v242-1551547892-project-member</nova:user>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:project uuid="12a4631cefff4ab3a81dcaeab669a0f6">tempest-TaggedBootDevicesTest_v242-1551547892</nova:project>
Oct 23 23:02:36 user nova-compute[74482]:       </nova:owner>
Oct 23 23:02:36 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:02:36 user nova-compute[74482]:       <nova:ports>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:port uuid="229b40af-c026-4f7a-a07d-f852450c0713">
Oct 23 23:02:36 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 23:02:36 user nova-compute[74482]:         </nova:port>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:port uuid="64a8d2d7-d71f-490b-b790-dfdca8b496c7">
Oct 23 23:02:36 user nova-compute[74482]:           <nova:ip type="fixed" address="10.1.1.207" ipVersion="4"/>
Oct 23 23:02:36 user nova-compute[74482]:         </nova:port>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:port uuid="1e3efc9d-4f87-47c8-bdf6-f88cf14ba097">
Oct 23 23:02:36 user nova-compute[74482]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Oct 23 23:02:36 user nova-compute[74482]:         </nova:port>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:port uuid="2bd68230-dccb-4d57-ae57-a5799925a6fc">
Oct 23 23:02:36 user nova-compute[74482]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Oct 23 23:02:36 user nova-compute[74482]:         </nova:port>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:port uuid="790f6250-f4da-4645-b46e-abd17525e803">
Oct 23 23:02:36 user nova-compute[74482]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Oct 23 23:02:36 user nova-compute[74482]:         </nova:port>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:port uuid="9a33e15e-c112-43ba-92be-faed55a7c76c">
Oct 23 23:02:36 user nova-compute[74482]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 23 23:02:36 user nova-compute[74482]:         </nova:port>
Oct 23 23:02:36 user nova-compute[74482]:         <nova:port uuid="94afaf97-3346-4e42-9201-65840d08a317">
Oct 23 23:02:36 user nova-compute[74482]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 23 23:02:36 user nova-compute[74482]:         </nova:port>
Oct 23 23:02:36 user nova-compute[74482]:       </nova:ports>
Oct 23 23:02:36 user nova-compute[74482]:     </nova:instance>
Oct 23 23:02:36 user nova-compute[74482]:   </metadata>
Oct 23 23:02:36 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:02:36 user nova-compute[74482]:     <system>
Oct 23 23:02:36 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:02:36 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:02:36 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:02:36 user nova-compute[74482]:       <entry name="serial">4f8e4516-738d-4440-938e-88ede5fe7b31</entry>
Oct 23 23:02:36 user nova-compute[74482]:       <entry name="uuid">4f8e4516-738d-4440-938e-88ede5fe7b31</entry>
Oct 23 23:02:36 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:02:36 user nova-compute[74482]:     </system>
Oct 23 23:02:36 user nova-compute[74482]:   </sysinfo>
Oct 23 23:02:36 user nova-compute[74482]:   <os>
Oct 23 23:02:36 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:02:36 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:02:36 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:02:36 user nova-compute[74482]:   </os>
Oct 23 23:02:36 user nova-compute[74482]:   <features>
Oct 23 23:02:36 user nova-compute[74482]:     <acpi/>
Oct 23 23:02:36 user nova-compute[74482]:     <apic/>
Oct 23 23:02:36 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:02:36 user nova-compute[74482]:   </features>
Oct 23 23:02:36 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:02:36 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:02:36 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:02:36 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:02:36 user nova-compute[74482]:   </clock>
Oct 23 23:02:36 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:02:36 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:02:36 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:02:36 user nova-compute[74482]:   </cpu>
Oct 23 23:02:36 user nova-compute[74482]:   <devices>
Oct 23 23:02:36 user nova-compute[74482]:     <disk type="file" device="cdrom">
Oct 23 23:02:36 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 23:02:36 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/4f8e4516-738d-4440-938e-88ede5fe7b31/disk.config"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="hda" bus="ide"/>
Oct 23 23:02:36 user nova-compute[74482]:     </disk>
Oct 23 23:02:36 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:02:36 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:36 user nova-compute[74482]:       <source dev="/dev/sde"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <serial>e1860888-6ec1-4ae7-8efc-a19ae27eb455</serial>
Oct 23 23:02:36 user nova-compute[74482]:     </disk>
Oct 23 23:02:36 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:02:36 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:36 user nova-compute[74482]:       <source dev="/dev/sdf"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <serial>d66b2221-0469-4917-a502-20c0d3c8f1a7</serial>
Oct 23 23:02:36 user nova-compute[74482]:     </disk>
Oct 23 23:02:36 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:02:36 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:36 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="vdc" bus="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <serial>e1365030-012b-4dde-9785-9b399480f9fe</serial>
Oct 23 23:02:36 user nova-compute[74482]:     </disk>
Oct 23 23:02:36 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:02:36 user nova-compute[74482]:       <mac address="fa:16:3e:23:9e:c7"/>
Oct 23 23:02:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="tap229b40af-c0"/>
Oct 23 23:02:36 user nova-compute[74482]:     </interface>
Oct 23 23:02:36 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:02:36 user nova-compute[74482]:       <mac address="fa:16:3e:56:83:68"/>
Oct 23 23:02:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="tap64a8d2d7-d7"/>
Oct 23 23:02:36 user nova-compute[74482]:     </interface>
Oct 23 23:02:36 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:02:36 user nova-compute[74482]:       <mac address="fa:16:3e:b7:79:fc"/>
Oct 23 23:02:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="tap1e3efc9d-4f"/>
Oct 23 23:02:36 user nova-compute[74482]:     </interface>
Oct 23 23:02:36 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:02:36 user nova-compute[74482]:       <mac address="fa:16:3e:98:1f:a6"/>
Oct 23 23:02:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="tap2bd68230-dc"/>
Oct 23 23:02:36 user nova-compute[74482]:     </interface>
Oct 23 23:02:36 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:02:36 user nova-compute[74482]:       <mac address="fa:16:3e:b5:97:57"/>
Oct 23 23:02:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="tap790f6250-f4"/>
Oct 23 23:02:36 user nova-compute[74482]:     </interface>
Oct 23 23:02:36 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:02:36 user nova-compute[74482]:       <mac address="fa:16:3e:c7:b1:59"/>
Oct 23 23:02:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="tap9a33e15e-c1"/>
Oct 23 23:02:36 user nova-compute[74482]:     </interface>
Oct 23 23:02:36 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:02:36 user nova-compute[74482]:       <mac address="fa:16:3e:d3:df:c7"/>
Oct 23 23:02:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:02:36 user nova-compute[74482]:       <target dev="tap94afaf97-33"/>
Oct 23 23:02:36 user nova-compute[74482]:     </interface>
Oct 23 23:02:36 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:02:36 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/4f8e4516-738d-4440-938e-88ede5fe7b31/console.log" append="off"/>
Oct 23 23:02:36 user nova-compute[74482]:     </serial>
Oct 23 23:02:36 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:02:36 user nova-compute[74482]:     <video>
Oct 23 23:02:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:36 user nova-compute[74482]:     </video>
Oct 23 23:02:36 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:02:36 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:02:36 user nova-compute[74482]:     </rng>
Oct 23 23:02:36 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:02:36 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:02:36 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:02:36 user nova-compute[74482]:     </memballoon>
Oct 23 23:02:36 user nova-compute[74482]:   </devices>
Oct 23 23:02:36 user nova-compute[74482]: </domain>
Oct 23 23:02:36 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:9e:c7,bridge_name='br-int',has_traffic_filtering=True,id=229b40af-c026-4f7a-a07d-f852450c0713,network=Network(56def97a-b5f4-4d08-9839-321a7f6669f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229b40af-c0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9e:c7,bridge_name='br-int',has_traffic_filtering=True,id=229b40af-c026-4f7a-a07d-f852450c0713,network=Network(56def97a-b5f4-4d08-9839-321a7f6669f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229b40af-c0') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eff7a7c9-db8e-50c9-b836-6a371c7acbf1', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcc3b56-d20c-456e-8da8-a229a429f362]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:36 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:36 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:36 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:36 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 (non-flash)
Oct 23 23:02:36 user nova-compute[74482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:36 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:36 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:36 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c436f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9'): ({'sdc'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Removing single pathed devices sdc {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap229b40af-c0, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap229b40af-c0, col_values=(('qos', UUID('afbade25-7dbc-4899-b245-842d1648497c')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap229b40af-c0, col_values=(('external_ids', {'iface-id': '229b40af-c026-4f7a-a07d-f852450c0713', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:9e:c7', 'vm-uuid': '4f8e4516-738d-4440-938e-88ede5fe7b31'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f56d08-80f0-432e-9fcc-5be65aafc569]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:36 user nova-compute[74482]: INFO nova.compute.manager [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Terminating instance
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.compute.manager [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: INFO os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:9e:c7,bridge_name='br-int',has_traffic_filtering=True,id=229b40af-c026-4f7a-a07d-f852450c0713,network=Network(56def97a-b5f4-4d08-9839-321a7f6669f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229b40af-c0')
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:68,bridge_name='br-int',has_traffic_filtering=True,id=64a8d2d7-d71f-490b-b790-dfdca8b496c7,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap64a8d2d7-d7') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:68,bridge_name='br-int',has_traffic_filtering=True,id=64a8d2d7-d71f-490b-b790-dfdca8b496c7,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap64a8d2d7-d7') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69ce11ff-9557-5ca2-9ac3-18ff7081d7d9', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b724685a-b8a4-4323-9d63-7048dcd59a56]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Flushing IO for device /dev/sdc {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3161e46a-2214-4e20-ae6e-681c34d8d9e8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64a8d2d7-d7, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64a8d2d7-d7, col_values=(('qos', UUID('8f3f48d5-0d23-4877-80cd-817a77f26670')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64a8d2d7-d7, col_values=(('external_ids', {'iface-id': '64a8d2d7-d71f-490b-b790-dfdca8b496c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:83:68', 'vm-uuid': '4f8e4516-738d-4440-938e-88ede5fe7b31'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: INFO os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:68,bridge_name='br-int',has_traffic_filtering=True,id=64a8d2d7-d71f-490b-b790-dfdca8b496c7,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap64a8d2d7-d7')
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e3efc9d-4f87-47c8-bdf6-f88cf14ba097,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3efc9d-4f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e3efc9d-4f87-47c8-bdf6-f88cf14ba097,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3efc9d-4f') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a19779-6ffa-4b3f-87d1-f8067d6e6f57]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a921414-a468-5add-97db-1a7c4039158c', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9531d8f5-900b-4d66-93bf-c5be87a57ab0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab363016-91d0-4031-83b3-c43fea52e3eb]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9, portal: 172.16.0.220,3260]
Oct 23 23:02:37 user nova-compute[74482]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:37 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e3efc9d-4f, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e3efc9d-4f, col_values=(('qos', UUID('0b540587-5767-4dcc-8425-734d2afe7ea4')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e3efc9d-4f, col_values=(('external_ids', {'iface-id': '1e3efc9d-4f87-47c8-bdf6-f88cf14ba097', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:79:fc', 'vm-uuid': '4f8e4516-738d-4440-938e-88ede5fe7b31'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63c27ba4-0456-45eb-bc43-dc992ebef1f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fda79bc-67eb-4dd0-8559-d9cb0bc93daf]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] <== disconnect_volume: return (2005ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.compute.manager [req-fc5a9985-1114-4bfc-b2ea-033f05765f9b req-232f9efa-e308-4e87-aa9c-4a3d9eb147d8 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received event network-vif-unplugged-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fc5a9985-1114-4bfc-b2ea-033f05765f9b req-232f9efa-e308-4e87-aa9c-4a3d9eb147d8 service nova] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fc5a9985-1114-4bfc-b2ea-033f05765f9b req-232f9efa-e308-4e87-aa9c-4a3d9eb147d8 service nova] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fc5a9985-1114-4bfc-b2ea-033f05765f9b req-232f9efa-e308-4e87-aa9c-4a3d9eb147d8 service nova] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.compute.manager [req-fc5a9985-1114-4bfc-b2ea-033f05765f9b req-232f9efa-e308-4e87-aa9c-4a3d9eb147d8 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] No waiting events found dispatching network-vif-unplugged-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.compute.manager [req-fc5a9985-1114-4bfc-b2ea-033f05765f9b req-232f9efa-e308-4e87-aa9c-4a3d9eb147d8 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received event network-vif-unplugged-e036d709-8377-45a6-a582-40ef5b175852 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: INFO os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e3efc9d-4f87-47c8-bdf6-f88cf14ba097,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3efc9d-4f')
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:1f:a6,bridge_name='br-int',has_traffic_filtering=True,id=2bd68230-dccb-4d57-ae57-a5799925a6fc,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd68230-dc') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:1f:a6,bridge_name='br-int',has_traffic_filtering=True,id=2bd68230-dccb-4d57-ae57-a5799925a6fc,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd68230-dc') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb0ae078-2404-59cb-a75d-5b24dd56992d', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bd68230-dc, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bd68230-dc, col_values=(('qos', UUID('d6413783-0253-475b-9a0e-9a20e4426b2d')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bd68230-dc, col_values=(('external_ids', {'iface-id': '2bd68230-dccb-4d57-ae57-a5799925a6fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:1f:a6', 'vm-uuid': '4f8e4516-738d-4440-938e-88ede5fe7b31'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: INFO os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:1f:a6,bridge_name='br-int',has_traffic_filtering=True,id=2bd68230-dccb-4d57-ae57-a5799925a6fc,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd68230-dc')
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:97:57,bridge_name='br-int',has_traffic_filtering=True,id=790f6250-f4da-4645-b46e-abd17525e803,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790f6250-f4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:97:57,bridge_name='br-int',has_traffic_filtering=True,id=790f6250-f4da-4645-b46e-abd17525e803,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790f6250-f4') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eda1a15e-8fd5-5709-9005-6dbe0d1bbaa8', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap790f6250-f4, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap790f6250-f4, col_values=(('qos', UUID('54e00db5-2f6c-4342-9cd5-f5c87c9e4924')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap790f6250-f4, col_values=(('external_ids', {'iface-id': '790f6250-f4da-4645-b46e-abd17525e803', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:97:57', 'vm-uuid': '4f8e4516-738d-4440-938e-88ede5fe7b31'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: INFO os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:97:57,bridge_name='br-int',has_traffic_filtering=True,id=790f6250-f4da-4645-b46e-abd17525e803,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790f6250-f4')
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b1:59,bridge_name='br-int',has_traffic_filtering=True,id=9a33e15e-c112-43ba-92be-faed55a7c76c,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a33e15e-c1') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b1:59,bridge_name='br-int',has_traffic_filtering=True,id=9a33e15e-c112-43ba-92be-faed55a7c76c,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a33e15e-c1') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e2e9995-60ea-57dd-9a68-6d8fa1c50a8d', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:37 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Instance destroyed successfully.
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.objects.instance [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lazy-loading 'resources' on Instance uuid 3357081e-0244-4351-8ad9-ac87685f5832 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T22:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-378438857',display_name='tempest-AttachSCSIVolumeTestJSON-server-378438857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-378438857',id=7,image_ref='58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCI31YHwj9NQLW826YLHCnDTlu2OMaWRBCNKi6WllvLtD0S8AlN2O5d0++NaBLfMxBXYICTBRzG5QnzOuVewtC4YCSVcuXH0ERneU2tmabAplzmKcs4qLLLF6HKCYb7fbw==',key_name='tempest-keypair-330369939',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='920c8f16da7c46f1b39f0b0909a89967',ramdisk_id='',reservation_id='r-6zma8s90',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='58bf8ed5-9d2c-4e26-ba47-0aa9f34f59c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1758481439',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1758481439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba015688326e400fbfbdb3c5192742d1',uuid=3357081e-0244-4351-8ad9-ac87685f5832,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Converting VIF {"id": "e036d709-8377-45a6-a582-40ef5b175852", "address": "fa:16:3e:1a:8b:cd", "network": {"id": "c6a352f8-53f5-4cdc-bec7-860fa4ff4c17", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1637975626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920c8f16da7c46f1b39f0b0909a89967", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape036d709-83", "ovs_interfaceid": "e036d709-8377-45a6-a582-40ef5b175852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:8b:cd,bridge_name='br-int',has_traffic_filtering=True,id=e036d709-8377-45a6-a582-40ef5b175852,network=Network(c6a352f8-53f5-4cdc-bec7-860fa4ff4c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape036d709-83') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG os_vif [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:8b:cd,bridge_name='br-int',has_traffic_filtering=True,id=e036d709-8377-45a6-a582-40ef5b175852,network=Network(c6a352f8-53f5-4cdc-bec7-860fa4ff4c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape036d709-83') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape036d709-83, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:02:37 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Creating image(s)
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Ensure instance console log exists: /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Start _get_guest_xml network_info=[{"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPKYvIin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa28db49-fd2f-4d64-96c3-4c14d805a37a', 'attached_at': '', 'detached_at': '', 'volume_id': '78c9cff8-3189-4532-9d6d-bb7236e4d446', 'serial': '78c9cff8-3189-4532-9d6d-bb7236e4d446'}, 'disk_bus': 'virtio', 'attachment_id': '80e94649-c36a-402b-94d1-1ba7470b0c48', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a33e15e-c1, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a33e15e-c1, col_values=(('qos', UUID('76e71d45-9c3e-4d93-a883-a0115c87a207')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a33e15e-c1, col_values=(('external_ids', {'iface-id': '9a33e15e-c112-43ba-92be-faed55a7c76c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:b1:59', 'vm-uuid': '4f8e4516-738d-4440-938e-88ede5fe7b31'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:37 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:02:37 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:02:37 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPKYvIin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:38 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:38 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:38 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cc20ae-77f5-42c0-bdaa-fe81a2bf188e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:02:38 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: INFO os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b1:59,bridge_name='br-int',has_traffic_filtering=True,id=9a33e15e-c112-43ba-92be-faed55a7c76c,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a33e15e-c1')
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:df:c7,bridge_name='br-int',has_traffic_filtering=True,id=94afaf97-3346-4e42-9201-65840d08a317,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94afaf97-33') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:df:c7,bridge_name='br-int',has_traffic_filtering=True,id=94afaf97-3346-4e42-9201-65840d08a317,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94afaf97-33') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70ec76a0-74f3-4f87-a140-d828edc7cc59) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8327b87a-897d-46b7-834a-acb791e61e6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446] added
Oct 23 23:02:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8908a476-b203-427b-b17b-da3627dfdfe2]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f33778-ab5e-45d4-8f06-4dcc8d7730e3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPKYvIin {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPKYvIin" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae040a5-7692-47cd-b377-273bc786e665]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FPKYvIin'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddedbe29-fd45-465a-9a88-eceef48cfa7f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[655c8948-5877-4a0d-b2b0-6acd3081b101]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccdca05d-77f8-548d-9c17-a3b3916d17f6', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: INFO os_vif [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:8b:cd,bridge_name='br-int',has_traffic_filtering=True,id=e036d709-8377-45a6-a582-40ef5b175852,network=Network(c6a352f8-53f5-4cdc-bec7-860fa4ff4c17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape036d709-83')
Oct 23 23:02:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Deleting instance files /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832_del
Oct 23 23:02:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Deletion of /opt/stack/data/nova/instances/3357081e-0244-4351-8ad9-ac87685f5832_del complete
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e695f69d-9cda-43b2-aaa4-f4618852e047]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446, portal: 172.16.0.220,3260]
Oct 23 23:02:38 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cb976b-d666-4712-8ddf-3c031508a3f4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94afaf97-33, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94afaf97-33, col_values=(('qos', UUID('8c66d976-782e-40c0-a51d-eac13189a962')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94afaf97-33, col_values=(('external_ids', {'iface-id': '94afaf97-3346-4e42-9201-65840d08a317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:df:c7', 'vm-uuid': '4f8e4516-738d-4440-938e-88ede5fe7b31'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9f60dd-e157-41ca-b03c-757cc209de0d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: INFO nova.compute.manager [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Took 1.64 seconds to destroy the instance on the hypervisor.
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:38 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:02:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] HCTL ('34', '-', '-', 0) found on session 8 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lazy-loading 'flavor' on Instance uuid 903923e6-8faa-4c46-9b5f-1b611f6902dc {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40fc0ad-a386-426c-8145-659c02724903]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPKYvIin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:38 user nova-compute[74482]: INFO os_vif [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:df:c7,bridge_name='br-int',has_traffic_filtering=True,id=94afaf97-3346-4e42-9201-65840d08a317,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94afaf97-33')
Oct 23 23:02:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ff483557-b608-4751-ab7a-1164820ad477 tempest-VolumesAssistedSnapshotsTest-1813635929 tempest-VolumesAssistedSnapshotsTest-1813635929-project-admin] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.215s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] No BDM found with device name hda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] No VIF found with MAC fa:16:3e:23:9e:c7, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:02:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] No VIF found with MAC fa:16:3e:b5:97:57, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:02:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Using config drive
Oct 23 23:02:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Creating config drive at /opt/stack/data/nova/instances/4f8e4516-738d-4440-938e-88ede5fe7b31/disk.config
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4f8e4516-738d-4440-938e-88ede5fe7b31/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7yahqvr8 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4f8e4516-738d-4440-938e-88ede5fe7b31/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7yahqvr8" returned: 0 in 0.062s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received event network-vif-plugged-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] Acquiring lock "3357081e-0244-4351-8ad9-ac87685f5832-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] Lock "3357081e-0244-4351-8ad9-ac87685f5832-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] No waiting events found dispatching network-vif-plugged-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:39 user nova-compute[74482]: WARNING nova.compute.manager [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received unexpected event network-vif-plugged-e036d709-8377-45a6-a582-40ef5b175852 for instance with vm_state active and task_state deleting.
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received event network-vif-plugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] Acquiring lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] No waiting events found dispatching network-vif-plugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:39 user nova-compute[74482]: WARNING nova.compute.manager [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received unexpected event network-vif-plugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 for instance with vm_state building and task_state spawning.
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received event network-vif-plugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] Acquiring lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] No waiting events found dispatching network-vif-plugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:39 user nova-compute[74482]: WARNING nova.compute.manager [req-7078b9da-a411-47a2-bae4-90b99be6677c req-21f5baea-a4a2-4020-b6d5-f02b75044e16 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received unexpected event network-vif-plugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 for instance with vm_state building and task_state spawning.
Oct 23 23:02:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '26463356431613238', 'path': '/dev/sdc'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463356431613238', 'path': '/dev/sdc'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-943860777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-943860777',id=11,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-20n6qgib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:02:11Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=aa28db49-fd2f-4d64-96c3-4c14d805a37a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:7c:fa,bridge_name='br-int',has_traffic_filtering=True,id=9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca04dd6-98') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.objects.instance [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'pci_devices' on Instance uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:02:39 user nova-compute[74482]:   <uuid>aa28db49-fd2f-4d64-96c3-4c14d805a37a</uuid>
Oct 23 23:02:39 user nova-compute[74482]:   <name>instance-0000000b</name>
Oct 23 23:02:39 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:02:39 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:02:39 user nova-compute[74482]:   <metadata>
Oct 23 23:02:39 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:02:39 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:02:39 user nova-compute[74482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-943860777</nova:name>
Oct 23 23:02:39 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:02:37</nova:creationTime>
Oct 23 23:02:39 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:02:39 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:02:39 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:02:39 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:02:39 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:02:39 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:02:39 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:02:39 user nova-compute[74482]:       <nova:owner>
Oct 23 23:02:39 user nova-compute[74482]:         <nova:user uuid="ebd17d342e7145e0bad04188ec8be780">tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member</nova:user>
Oct 23 23:02:39 user nova-compute[74482]:         <nova:project uuid="981f084ec65e4fa0a9cbd2e5edf8302a">tempest-ServerBootFromVolumeStableRescueTest-157113739</nova:project>
Oct 23 23:02:39 user nova-compute[74482]:       </nova:owner>
Oct 23 23:02:39 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:02:39 user nova-compute[74482]:       <nova:ports>
Oct 23 23:02:39 user nova-compute[74482]:         <nova:port uuid="9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8">
Oct 23 23:02:39 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 23:02:39 user nova-compute[74482]:         </nova:port>
Oct 23 23:02:39 user nova-compute[74482]:       </nova:ports>
Oct 23 23:02:39 user nova-compute[74482]:     </nova:instance>
Oct 23 23:02:39 user nova-compute[74482]:   </metadata>
Oct 23 23:02:39 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:02:39 user nova-compute[74482]:     <system>
Oct 23 23:02:39 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:02:39 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:02:39 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:02:39 user nova-compute[74482]:       <entry name="serial">aa28db49-fd2f-4d64-96c3-4c14d805a37a</entry>
Oct 23 23:02:39 user nova-compute[74482]:       <entry name="uuid">aa28db49-fd2f-4d64-96c3-4c14d805a37a</entry>
Oct 23 23:02:39 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:02:39 user nova-compute[74482]:     </system>
Oct 23 23:02:39 user nova-compute[74482]:   </sysinfo>
Oct 23 23:02:39 user nova-compute[74482]:   <os>
Oct 23 23:02:39 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:02:39 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:02:39 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:02:39 user nova-compute[74482]:   </os>
Oct 23 23:02:39 user nova-compute[74482]:   <features>
Oct 23 23:02:39 user nova-compute[74482]:     <acpi/>
Oct 23 23:02:39 user nova-compute[74482]:     <apic/>
Oct 23 23:02:39 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:02:39 user nova-compute[74482]:   </features>
Oct 23 23:02:39 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:02:39 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:02:39 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:02:39 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:02:39 user nova-compute[74482]:   </clock>
Oct 23 23:02:39 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:02:39 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:02:39 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:02:39 user nova-compute[74482]:   </cpu>
Oct 23 23:02:39 user nova-compute[74482]:   <devices>
Oct 23 23:02:39 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:02:39 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:02:39 user nova-compute[74482]:       <source dev="/dev/sdc"/>
Oct 23 23:02:39 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:02:39 user nova-compute[74482]:       <serial>78c9cff8-3189-4532-9d6d-bb7236e4d446</serial>
Oct 23 23:02:39 user nova-compute[74482]:     </disk>
Oct 23 23:02:39 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:02:39 user nova-compute[74482]:       <mac address="fa:16:3e:5a:7c:fa"/>
Oct 23 23:02:39 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:39 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:02:39 user nova-compute[74482]:       <target dev="tap9ca04dd6-98"/>
Oct 23 23:02:39 user nova-compute[74482]:     </interface>
Oct 23 23:02:39 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:02:39 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/console.log" append="off"/>
Oct 23 23:02:39 user nova-compute[74482]:     </serial>
Oct 23 23:02:39 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:02:39 user nova-compute[74482]:     <video>
Oct 23 23:02:39 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:02:39 user nova-compute[74482]:     </video>
Oct 23 23:02:39 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:02:39 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:02:39 user nova-compute[74482]:     </rng>
Oct 23 23:02:39 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:02:39 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:02:39 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:02:39 user nova-compute[74482]:     </memballoon>
Oct 23 23:02:39 user nova-compute[74482]:   </devices>
Oct 23 23:02:39 user nova-compute[74482]: </domain>
Oct 23 23:02:39 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-943860777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-943860777',id=11,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-20n6qgib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:02:11Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=aa28db49-fd2f-4d64-96c3-4c14d805a37a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:7c:fa,bridge_name='br-int',has_traffic_filtering=True,id=9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca04dd6-98') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG os_vif [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:7c:fa,bridge_name='br-int',has_traffic_filtering=True,id=9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca04dd6-98') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca5118ad-c751-5488-9d5c-a2c700e40209', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ca04dd6-98, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ca04dd6-98, col_values=(('qos', UUID('005f092a-7cea-4049-aa55-540a9eea7ad5')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ca04dd6-98, col_values=(('external_ids', {'iface-id': '9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:7c:fa', 'vm-uuid': 'aa28db49-fd2f-4d64-96c3-4c14d805a37a'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:39 user nova-compute[74482]: INFO os_vif [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:7c:fa,bridge_name='br-int',has_traffic_filtering=True,id=9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca04dd6-98')
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No VIF found with MAC fa:16:3e:5a:7c:fa, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:02:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Instance spawned successfully.
Oct 23 23:02:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:02:40 user nova-compute[74482]: INFO nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Took 6.50 seconds to spawn the instance on the hypervisor.
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:02:40 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Took 1.70 seconds to deallocate network for instance.
Oct 23 23:02:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:40 user nova-compute[74482]: INFO nova.compute.manager [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Took 7.77 seconds to build instance.
Oct 23 23:02:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-df0e9fdc-46c9-49e4-913e-2a056b03ba96 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.916s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:02:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:40 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Deleted allocations for instance 3357081e-0244-4351-8ad9-ac87685f5832
Oct 23 23:02:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-44e2ebf7-23f8-4ebf-b0e7-cbf05cefa06f tempest-AttachSCSIVolumeTestJSON-1758481439 tempest-AttachSCSIVolumeTestJSON-1758481439-project-member] Lock "3357081e-0244-4351-8ad9-ac87685f5832" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.121s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-871ed509-3d8e-44bb-94e3-7ce214e8bd5a req-933a5e8d-80fe-494c-872b-7a50a57b9356 service nova] [instance: 3357081e-0244-4351-8ad9-ac87685f5832] Received event network-vif-deleted-e036d709-8377-45a6-a582-40ef5b175852 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-a0474f10-76a3-420e-8b63-335e9bae204f req-fcd0219c-221b-40fd-920a-7a93cfcc3b3d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a0474f10-76a3-420e-8b63-335e9bae204f req-fcd0219c-221b-40fd-920a-7a93cfcc3b3d service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a0474f10-76a3-420e-8b63-335e9bae204f req-fcd0219c-221b-40fd-920a-7a93cfcc3b3d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a0474f10-76a3-420e-8b63-335e9bae204f req-fcd0219c-221b-40fd-920a-7a93cfcc3b3d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-a0474f10-76a3-420e-8b63-335e9bae204f req-fcd0219c-221b-40fd-920a-7a93cfcc3b3d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:42 user nova-compute[74482]: WARNING nova.compute.manager [req-a0474f10-76a3-420e-8b63-335e9bae204f req-fcd0219c-221b-40fd-920a-7a93cfcc3b3d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-229b40af-c026-4f7a-a07d-f852450c0713 for instance with vm_state building and task_state spawning.
Oct 23 23:02:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:43 user nova-compute[74482]: WARNING nova.compute.manager [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state building and task_state spawning.
Oct 23 23:02:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:43 user nova-compute[74482]: WARNING nova.compute.manager [req-9e6461a0-9dfc-4d52-ac79-17140a8a6c72 req-08813acb-4f79-4771-b515-fad0e9c173d9 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state building and task_state spawning.
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-dfa13b56-53f4-4444-a58d-e09d2209ddf3 req-fc005a62-c7b4-4020-9f7d-6e35eab10f2a service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-dfa13b56-53f4-4444-a58d-e09d2209ddf3 req-fc005a62-c7b4-4020-9f7d-6e35eab10f2a service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-dfa13b56-53f4-4444-a58d-e09d2209ddf3 req-fc005a62-c7b4-4020-9f7d-6e35eab10f2a service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-dfa13b56-53f4-4444-a58d-e09d2209ddf3 req-fc005a62-c7b4-4020-9f7d-6e35eab10f2a service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-dfa13b56-53f4-4444-a58d-e09d2209ddf3 req-fc005a62-c7b4-4020-9f7d-6e35eab10f2a service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:43 user nova-compute[74482]: WARNING nova.compute.manager [req-dfa13b56-53f4-4444-a58d-e09d2209ddf3 req-fc005a62-c7b4-4020-9f7d-6e35eab10f2a service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 for instance with vm_state building and task_state spawning.
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:44 user nova-compute[74482]: WARNING nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-229b40af-c026-4f7a-a07d-f852450c0713 for instance with vm_state building and task_state spawning.
Oct 23 23:02:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:44 user nova-compute[74482]: WARNING nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 for instance with vm_state building and task_state spawning.
Oct 23 23:02:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:44 user nova-compute[74482]: WARNING nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 for instance with vm_state building and task_state spawning.
Oct 23 23:02:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:44 user nova-compute[74482]: WARNING nova.compute.manager [req-4fa09821-d123-4e6f-b9e3-4538a610dda6 req-3bae8f7b-28a4-45e5-9552-1aa199e6620d service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-2bd68230-dccb-4d57-ae57-a5799925a6fc for instance with vm_state building and task_state spawning.
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:45 user nova-compute[74482]: WARNING nova.compute.manager [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 for instance with vm_state building and task_state spawning.
Oct 23 23:02:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:45 user nova-compute[74482]: WARNING nova.compute.manager [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-94afaf97-3346-4e42-9201-65840d08a317 for instance with vm_state building and task_state spawning.
Oct 23 23:02:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:45 user nova-compute[74482]: WARNING nova.compute.manager [req-b094da41-9fcd-4d26-85b4-8f3f39b48e19 req-e3d1bc6a-6a51-4bf2-aca0-bf9114d5da0f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-94afaf97-3346-4e42-9201-65840d08a317 for instance with vm_state building and task_state spawning.
Oct 23 23:02:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:02:46 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Instance spawned successfully.
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:46 user nova-compute[74482]: WARNING nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-2bd68230-dccb-4d57-ae57-a5799925a6fc for instance with vm_state building and task_state spawning.
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:46 user nova-compute[74482]: WARNING nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-790f6250-f4da-4645-b46e-abd17525e803 for instance with vm_state building and task_state spawning.
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:46 user nova-compute[74482]: WARNING nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-790f6250-f4da-4645-b46e-abd17525e803 for instance with vm_state building and task_state spawning.
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:46 user nova-compute[74482]: WARNING nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-9a33e15e-c112-43ba-92be-faed55a7c76c for instance with vm_state building and task_state spawning.
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:02:46 user nova-compute[74482]: WARNING nova.compute.manager [req-33cbf0ba-328e-4a40-87ed-ec4a3a755941 req-ead70db4-bf20-4970-97f8-ac6a991ee84e service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-9a33e15e-c112-43ba-92be-faed55a7c76c for instance with vm_state building and task_state spawning.
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:46 user nova-compute[74482]: INFO nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Took 8.48 seconds to spawn the instance on the hypervisor.
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:02:46 user nova-compute[74482]: INFO nova.compute.manager [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Took 36.08 seconds to build instance.
Oct 23 23:02:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3665ab10-fe6b-4298-9352-c7719f80b071 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.256s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmfDFHRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8bdfd0e-24d2-4f31-a650-60edac47fc97', 'attached_at': '', 'detached_at': '', 'volume_id': '3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'serial': '3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIMeiUcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e8bdfd0e-24d2-4f31-a650-60edac47fc97', 'attached_at': '', 'detached_at': '', 'volume_id': '9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'serial'} {{(pid=74482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmfDFHRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:46 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:46 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:46 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d180dcbd-f960-4304-a4b8-4f67e05278ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:02:46 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8173f5-7606-49b1-b781-9e54c2502ddf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39] added
Oct 23 23:02:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f9f683-eb7e-466f-8444-e918b43dc523]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7950e71f-816e-4847-ac21-77a2f791da3f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmfDFHRP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmfDFHRP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dadc9f-080b-4e05-a84d-faf047522708]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NmfDFHRP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9a9249-75ef-448b-832e-6883efae0f75]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7668939d-9ede-4e0f-b024-f8a3f82c7061]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5616fe-1004-455a-8071-54966b67b789]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39, portal: 172.16.0.220,3260]
Oct 23 23:02:47 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03855a5b-c985-4225-adc2-407eacf071f6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e3a574-514f-4311-ae0d-91183e454119]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:02:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4ef20b-72ed-411e-89c3-ff57595eff79]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmfDFHRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:02:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance spawned successfully.
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:02:47 user nova-compute[74482]: INFO nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Took 16.09 seconds to spawn the instance on the hypervisor.
Oct 23 23:02:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:02:47 user nova-compute[74482]: INFO nova.compute.manager [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Took 77.35 seconds to build instance.
Oct 23 23:02:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-92681c5f-34ed-462d-ab24-658dce5cd959 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 77.528s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23562396239643333', 'path': '/dev/sdg'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562396239643333', 'path': '/dev/sdg'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:02:48 user nova-compute[74482]: DEBUG nova.objects.instance [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lazy-loading 'flavor' on Instance uuid e8bdfd0e-24d2-4f31-a650-60edac47fc97 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:02:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 180355072 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:02:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 354418688 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:02:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 527433728 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:02:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 676331520 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:02:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 850395136 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:02:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 990904320 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIMeiUcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:52 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d0d52c-e82a-4b31-8906-a79a6b6512d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:02:52 user nova-compute[74482]: No targets found.
Oct 23 23:02:52 user nova-compute[74482]: iSNS:
Oct 23 23:02:52 user nova-compute[74482]: No targets found.
Oct 23 23:02:52 user nova-compute[74482]: STATIC:
Oct 23 23:02:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e
Oct 23 23:02:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455
Oct 23 23:02:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7
Oct 23 23:02:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe
Oct 23 23:02:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39
Oct 23 23:02:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:02:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:02:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:02:52 user nova-compute[74482]: FIRMWARE:
Oct 23 23:02:52 user nova-compute[74482]: No targets found.
Oct 23 23:02:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:02:52 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:02:52 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd19521-83d9-43a9-b46c-444bec3435b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b7a2b-01df-469c-849a-31db7513c86d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:02:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:02:52 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:02:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c756950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e'): ({'sdd'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Removing single pathed devices sdd {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb65c49-707d-494d-abc7-1c0b4ce742fc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35833037-2481-407f-8bd0-458f8f5de3fc]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Flushing IO for device /dev/sdd {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4a9a38-cc5e-4dd4-afed-fe37beb54003]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[272f0009-16a0-45d1-a6a1-9909a85ad642]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45172f3-6a5e-450d-8084-68d6c9b24122]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[51450c1f-3502-4a7c-8044-4144dc79bff3]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260]
Oct 23 23:02:52 user nova-compute[74482]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260] successful.
Oct 23 23:02:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b66dbdd-9831-4092-88a9-f8957d2d76d2]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] <== disconnect_volume: return (349ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmfDFHRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e8bdfd0e-24d2-4f31-a650-60edac47fc97', 'attached_at': '', 'detached_at': '', 'volume_id': '3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'serial'} {{(pid=74482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 23 23:02:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] swap_volume: removing Cinder connection for volume 9e098ec9-c890-45b4-8dbb-3eb0126d9d7e {{(pid=74482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 23 23:02:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] swap_volume: Updating volume 9e098ec9-c890-45b4-8dbb-3eb0126d9d7e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NmfDFHRP", "auth_password": "0Pz7lNe9FytTr1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39"}, "status": "reserved", "instance": "e8bdfd0e-24d2-4f31-a650-60edac47fc97", "attached_at": "", "detached_at": "", "volume_id": "3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39", "serial": "3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'no_device': None, 'attachment_id': 'f18e9038-5e14-4acf-9fe4-5862fa567e64'} {{(pid=74482) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 23 23:02:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cd5715d1-a727-4379-bd92-4795a0ef1999 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 32.975s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:57 user nova-compute[74482]: DEBUG nova.objects.instance [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'flavor' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:02:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:02:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:58 user nova-compute[74482]: INFO nova.compute.manager [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Attaching volume c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e to /dev/vdb
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.utils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e62503-bcd0-4c1d-894b-fdc29a33cb64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21236704-07d0-4a4d-b803-7a55d1917101]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e51af3-4efe-44e3-96bd-1af117061f0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1090b1-2267-4d84-a9c4-047482b72ddd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.utils [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:58 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39b9b85-a92f-43fc-8bee-ab5c90f6fe3b]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[095331a9-c5bb-4f6a-905d-177471279958]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.utils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating existing volume attachment record: 735057ea-ebf1-43ee-83ec-f6bc7b183457 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f956c829-5698-4b48-8cee-a2450c6d9d44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c4312-5c96-4336-bc26-551e6a0f7767]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[94969498-aa56-4bf5-998e-bd9953b1703c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:02:58 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:02:58 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffa085f-ed2e-4d53-92c0-c207b2c9fe6f]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:02:58 user nova-compute[74482]: DEBUG os_brick.utils [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:02:58 user nova-compute[74482]: INFO nova.compute.manager [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Swapping volume 3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 for 9e098ec9-c890-45b4-8dbb-3eb0126d9d7e
Oct 23 23:02:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG nova.objects.instance [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lazy-loading 'flavor' on Instance uuid aa063829-b117-40f4-93f2-358b33f1d156 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:03:01 user nova-compute[74482]: INFO nova.compute.claims [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Claim successful on node user
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:01 user nova-compute[74482]: INFO nova.compute.manager [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Attaching volume a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 to /dev/vdb
Oct 23 23:03:01 user nova-compute[74482]: DEBUG os_brick.utils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa8e2e2-dee2-4eeb-b04c-1bd9be91dd52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb360d76-7e47-4c64-abdf-d3e6c0303091]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[178ab7cb-2d46-4ac1-adf5-fec4b1ad34e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a802627-1018-47a1-a5d1-1b819cd48a38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:03:01 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e77dcff-8675-4cd8-a4e4-92ebe646e3ec]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG os_brick.utils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating existing volume attachment record: 67256bcb-6429-44e2-92cb-f249ead46ab3 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.773s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:03:02 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:03:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG nova.policy [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6e62933fe47479baf3029e44d3b8759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7418b41ef984478daf12ce3a2c72c3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:03:02 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Creating image(s)
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.248s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk 1073741824" returned: 0 in 0.057s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Successfully created port: f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.234s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Cannot resize image /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Ensure instance console log exists: /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Successfully updated port: f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "refresh_cache-2a91897d-e83c-4396-8584-c8ff4fcfc553" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquired lock "refresh_cache-2a91897d-e83c-4396-8584-c8ff4fcfc553" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-3ffde562-5508-4c3f-8eab-013ea23639fa req-bbc10b13-0baf-4925-a924-cc66ed76d3c4 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-changed-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-3ffde562-5508-4c3f-8eab-013ea23639fa req-bbc10b13-0baf-4925-a924-cc66ed76d3c4 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Refreshing instance network info cache due to event network-changed-f4d3d364-6576-469e-b136-32509ea1bef0. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3ffde562-5508-4c3f-8eab-013ea23639fa req-bbc10b13-0baf-4925-a924-cc66ed76d3c4 service nova] Acquiring lock "refresh_cache-2a91897d-e83c-4396-8584-c8ff4fcfc553" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:03:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Updating instance_info_cache with network_info: [{"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Releasing lock "refresh_cache-2a91897d-e83c-4396-8584-c8ff4fcfc553" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Instance network_info: |[{"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3ffde562-5508-4c3f-8eab-013ea23639fa req-bbc10b13-0baf-4925-a924-cc66ed76d3c4 service nova] Acquired lock "refresh_cache-2a91897d-e83c-4396-8584-c8ff4fcfc553" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-3ffde562-5508-4c3f-8eab-013ea23639fa req-bbc10b13-0baf-4925-a924-cc66ed76d3c4 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Refreshing network info cache for port f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Start _get_guest_xml network_info=[{"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:03:04 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:03:04 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1405955470',display_name='tempest-tempest.common.compute-instance-1405955470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1405955470',id=13,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+kFDD4wwJWW/1hObOOzjmoSpoVE08++Rl7M3rZ7hasNILrz2Hts0rh2BR+TeMo8ArCwaM5O7vBiIcCD76Cv0A5UMS3pbhQxU/biWWpIfcmTYASw0GYH12Hz9/vT8pENw==',key_name='tempest-keypair-25770726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-wps4jnhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:03:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=2a91897d-e83c-4396-8584-c8ff4fcfc553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.objects.instance [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a91897d-e83c-4396-8584-c8ff4fcfc553 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:03:04 user nova-compute[74482]:   <uuid>2a91897d-e83c-4396-8584-c8ff4fcfc553</uuid>
Oct 23 23:03:04 user nova-compute[74482]:   <name>instance-0000000d</name>
Oct 23 23:03:04 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:03:04 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:03:04 user nova-compute[74482]:   <metadata>
Oct 23 23:03:04 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:03:04 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:03:04 user nova-compute[74482]:       <nova:name>tempest-tempest.common.compute-instance-1405955470</nova:name>
Oct 23 23:03:04 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:03:04</nova:creationTime>
Oct 23 23:03:04 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:03:04 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:03:04 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:03:04 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:03:04 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:03:04 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:03:04 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:03:04 user nova-compute[74482]:       <nova:owner>
Oct 23 23:03:04 user nova-compute[74482]:         <nova:user uuid="a6e62933fe47479baf3029e44d3b8759">tempest-ServerActionsTestOtherA-1928343369-project-member</nova:user>
Oct 23 23:03:04 user nova-compute[74482]:         <nova:project uuid="7418b41ef984478daf12ce3a2c72c3c6">tempest-ServerActionsTestOtherA-1928343369</nova:project>
Oct 23 23:03:04 user nova-compute[74482]:       </nova:owner>
Oct 23 23:03:04 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:03:04 user nova-compute[74482]:       <nova:ports>
Oct 23 23:03:04 user nova-compute[74482]:         <nova:port uuid="f4d3d364-6576-469e-b136-32509ea1bef0">
Oct 23 23:03:04 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 23:03:04 user nova-compute[74482]:         </nova:port>
Oct 23 23:03:04 user nova-compute[74482]:       </nova:ports>
Oct 23 23:03:04 user nova-compute[74482]:     </nova:instance>
Oct 23 23:03:04 user nova-compute[74482]:   </metadata>
Oct 23 23:03:04 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:03:04 user nova-compute[74482]:     <system>
Oct 23 23:03:04 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:03:04 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:03:04 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:03:04 user nova-compute[74482]:       <entry name="serial">2a91897d-e83c-4396-8584-c8ff4fcfc553</entry>
Oct 23 23:03:04 user nova-compute[74482]:       <entry name="uuid">2a91897d-e83c-4396-8584-c8ff4fcfc553</entry>
Oct 23 23:03:04 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:03:04 user nova-compute[74482]:     </system>
Oct 23 23:03:04 user nova-compute[74482]:   </sysinfo>
Oct 23 23:03:04 user nova-compute[74482]:   <os>
Oct 23 23:03:04 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:03:04 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:03:04 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:03:04 user nova-compute[74482]:   </os>
Oct 23 23:03:04 user nova-compute[74482]:   <features>
Oct 23 23:03:04 user nova-compute[74482]:     <acpi/>
Oct 23 23:03:04 user nova-compute[74482]:     <apic/>
Oct 23 23:03:04 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:03:04 user nova-compute[74482]:   </features>
Oct 23 23:03:04 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:03:04 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:03:04 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:03:04 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:03:04 user nova-compute[74482]:   </clock>
Oct 23 23:03:04 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:03:04 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:03:04 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:03:04 user nova-compute[74482]:   </cpu>
Oct 23 23:03:04 user nova-compute[74482]:   <devices>
Oct 23 23:03:04 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:03:04 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:03:04 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk"/>
Oct 23 23:03:04 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:03:04 user nova-compute[74482]:     </disk>
Oct 23 23:03:04 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:03:04 user nova-compute[74482]:       <mac address="fa:16:3e:68:49:59"/>
Oct 23 23:03:04 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:03:04 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:03:04 user nova-compute[74482]:       <target dev="tapf4d3d364-65"/>
Oct 23 23:03:04 user nova-compute[74482]:     </interface>
Oct 23 23:03:04 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:03:04 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/console.log" append="off"/>
Oct 23 23:03:04 user nova-compute[74482]:     </serial>
Oct 23 23:03:04 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:03:04 user nova-compute[74482]:     <video>
Oct 23 23:03:04 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:03:04 user nova-compute[74482]:     </video>
Oct 23 23:03:04 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:03:04 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:03:04 user nova-compute[74482]:     </rng>
Oct 23 23:03:04 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:03:04 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:03:04 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:03:04 user nova-compute[74482]:     </memballoon>
Oct 23 23:03:04 user nova-compute[74482]:   </devices>
Oct 23 23:03:04 user nova-compute[74482]: </domain>
Oct 23 23:03:04 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1405955470',display_name='tempest-tempest.common.compute-instance-1405955470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1405955470',id=13,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+kFDD4wwJWW/1hObOOzjmoSpoVE08++Rl7M3rZ7hasNILrz2Hts0rh2BR+TeMo8ArCwaM5O7vBiIcCD76Cv0A5UMS3pbhQxU/biWWpIfcmTYASw0GYH12Hz9/vT8pENw==',key_name='tempest-keypair-25770726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-wps4jnhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:03:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=2a91897d-e83c-4396-8584-c8ff4fcfc553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG os_vif [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e21342e-1532-55ae-94ab-102746c3a7a8', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4d3d364-65, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4d3d364-65, col_values=(('qos', UUID('a633191f-8d23-47e9-8c01-f1efa7ac2886')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4d3d364-65, col_values=(('external_ids', {'iface-id': 'f4d3d364-6576-469e-b136-32509ea1bef0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:49:59', 'vm-uuid': '2a91897d-e83c-4396-8584-c8ff4fcfc553'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:04 user nova-compute[74482]: INFO os_vif [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65')
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No VIF found with MAC fa:16:3e:68:49:59, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-3ffde562-5508-4c3f-8eab-013ea23639fa req-bbc10b13-0baf-4925-a924-cc66ed76d3c4 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Updated VIF entry in instance network info cache for port f4d3d364-6576-469e-b136-32509ea1bef0. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-3ffde562-5508-4c3f-8eab-013ea23639fa req-bbc10b13-0baf-4925-a924-cc66ed76d3c4 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Updating instance_info_cache with network_info: [{"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:03:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3ffde562-5508-4c3f-8eab-013ea23639fa req-bbc10b13-0baf-4925-a924-cc66ed76d3c4 service nova] Releasing lock "refresh_cache-2a91897d-e83c-4396-8584-c8ff4fcfc553" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:03:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-9e62f66f-9a1a-4bc2-ba3c-f36dd4c36efa req-1a99ad39-505d-45df-a6da-8b51106a87fd service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9e62f66f-9a1a-4bc2-ba3c-f36dd4c36efa req-1a99ad39-505d-45df-a6da-8b51106a87fd service nova] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9e62f66f-9a1a-4bc2-ba3c-f36dd4c36efa req-1a99ad39-505d-45df-a6da-8b51106a87fd service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9e62f66f-9a1a-4bc2-ba3c-f36dd4c36efa req-1a99ad39-505d-45df-a6da-8b51106a87fd service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-9e62f66f-9a1a-4bc2-ba3c-f36dd4c36efa req-1a99ad39-505d-45df-a6da-8b51106a87fd service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] No waiting events found dispatching network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:05 user nova-compute[74482]: WARNING nova.compute.manager [req-9e62f66f-9a1a-4bc2-ba3c-f36dd4c36efa req-1a99ad39-505d-45df-a6da-8b51106a87fd service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received unexpected event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 for instance with vm_state building and task_state spawning.
Oct 23 23:03:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-c692013b-f94d-4c0f-b9a9-25a4004a4a1d req-d04bd735-7577-47ac-9e56-7257b5ac7edc service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c692013b-f94d-4c0f-b9a9-25a4004a4a1d req-d04bd735-7577-47ac-9e56-7257b5ac7edc service nova] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c692013b-f94d-4c0f-b9a9-25a4004a4a1d req-d04bd735-7577-47ac-9e56-7257b5ac7edc service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c692013b-f94d-4c0f-b9a9-25a4004a4a1d req-d04bd735-7577-47ac-9e56-7257b5ac7edc service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-c692013b-f94d-4c0f-b9a9-25a4004a4a1d req-d04bd735-7577-47ac-9e56-7257b5ac7edc service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] No waiting events found dispatching network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:07 user nova-compute[74482]: WARNING nova.compute.manager [req-c692013b-f94d-4c0f-b9a9-25a4004a4a1d req-d04bd735-7577-47ac-9e56-7257b5ac7edc service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received unexpected event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 for instance with vm_state building and task_state spawning.
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:03:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Instance spawned successfully.
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:03:08 user nova-compute[74482]: INFO nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Took 6.22 seconds to spawn the instance on the hypervisor.
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:03:08 user nova-compute[74482]: INFO nova.compute.manager [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Took 7.50 seconds to build instance.
Oct 23 23:03:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-771080ee-d574-4740-9c9b-d0890532b4b2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.630s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:03:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updating instance_info_cache with network_info: [{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:03:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:03:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:14 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:03:14 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:03:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7548MB free_disk=25.26854705810547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:03:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa063829-b117-40f4-93f2-358b33f1d156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 903923e6-8faa-4c46-9b5f-1b611f6902dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4f8e4516-738d-4440-938e-88ede5fe7b31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 31c01877-ca5c-45cd-b85a-ec624b3e2a3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:03:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFqUOnra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:20 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:20 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:20 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b50b2d-b1c2-4ad2-8ed9-40f6f4f6cdd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:03:20 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b868933e-9aa4-4ed5-af62-c0b66fd68f25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e] added
Oct 23 23:03:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIMeiUcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8bdfd0e-24d2-4f31-a650-60edac47fc97', 'attached_at': '', 'detached_at': '', 'volume_id': '9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'serial': '9e098ec9-c890-45b4-8dbb-3eb0126d9d7e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmfDFHRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39'}, 'status': 'reserved', 'instance': 'e8bdfd0e-24d2-4f31-a650-60edac47fc97', 'attached_at': '', 'detached_at': '', 'volume_id': '3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'serial'} {{(pid=74482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b40baf4-a61d-4c92-8d15-1d32f5fe019b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIMeiUcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:20 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcca902-4566-441a-be83-aa580ae23141]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFqUOnra {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFqUOnra" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b6b666-c4dc-40ad-9e42-f6892c971d37]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DFqUOnra'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b61d652-1af7-48ee-9c3a-4f310a1372b5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4260b4-e0ca-45ae-91c5-ba55f10c73d2]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f01b66-ad42-4793-9dd3-b4b31e38d0f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e, portal: 172.16.0.220,3260]
Oct 23 23:03:20 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e, portal: 172.16.0.220,3260] successful.
Oct 23 23:03:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d289733-31bf-4d36-8eb8-f52c4e8dad8d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e28729a-d25f-42e6-a177-92d70769e2d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9863a89d-805a-4dba-ac82-d314ea236dc2]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:03:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFqUOnra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '26636363566656534', 'path': '/dev/sdd'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636363566656534', 'path': '/dev/sdd'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.343s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:21 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:21 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'flavor' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f829bf-090f-4ba3-973a-679477cc4af2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:03:21 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:03:21 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:03:21 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:03:21 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:03:21 user nova-compute[74482]:   <serial>c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e</serial>
Oct 23 23:03:21 user nova-compute[74482]: </disk>
Oct 23 23:03:21 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c76b36-dff8-4fb6-843f-84594cb223aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e] added
Oct 23 23:03:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[285d1836-1bf1-4865-b9a6-2613b32173fa]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d59de1-6208-4545-8d49-8cb90627473e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIMeiUcp {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIMeiUcp" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fc73ac-078d-41bd-9e28-5fde64497f88]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XIMeiUcp'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df62564-2b78-4fd8-b04c-9830ebcc6a4d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5368291-703d-4a2c-9aee-22d3590f3848]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eda908-580d-4a0c-bf24-2b3b2aa8373d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260]
Oct 23 23:03:21 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260] successful.
Oct 23 23:03:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c48c01-2ab8-4a63-95df-314ff7aebab3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebbc634-d9c3-4bbc-9a74-a465897ecc12]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[330d9879-972f-4a9d-b29f-d0d541e0773f]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:03:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIMeiUcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] No VIF found with MAC fa:16:3e:f3:68:bb, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-58e9d542-281c-4409-b32f-05bda3743a3b tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.205s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:22 user nova-compute[74482]: INFO nova.compute.manager [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Rescuing
Oct 23 23:03:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquired lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] <== connect_volume: return (2753ms) {'type': 'block', 'scsi_wwn': '23263643933303833', 'path': '/dev/sdh'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263643933303833', 'path': '/dev/sdh'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:03:22 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lazy-loading 'flavor' on Instance uuid e8bdfd0e-24d2-4f31-a650-60edac47fc97 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating instance_info_cache with network_info: [{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Releasing lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:23 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:23 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:23 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2978e8d5-bdc9-4de5-baa2-0770d0884bf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:03:23 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf67420f-9a99-4121-bbf0-21af966c2883]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368] added
Oct 23 23:03:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9d03ff-d0d8-4617-925a-984091a0c2f4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a8eb80-90b9-4de6-9fd1-de415b803573]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrQcGyOU {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrQcGyOU" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38f1470-a401-4427-867a-077fa32865e5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZrQcGyOU'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de2c96f-5663-42b7-a10a-bf458d6a1636]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.059s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d01f79b-e690-48a1-a593-5d247a9d8890]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:23 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 109051904 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --login" returned: 0 in 0.395s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[27660564-8044-4541-a899-1e365db9c134]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]
Oct 23 23:03:24 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.
Oct 23 23:03:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.125s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fa627d-09b8-4119-8a11-fe72ce191940]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bcb8f0-7655-414f-bb4b-d29c2c11c099]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.854s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db3885a-8ef3-4ce2-b723-5a93999674ea]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-a56bef2c-5bf8-4a4c-b2ae-0aa20ede59b9 req-d53ff44e-3d3a-44ee-8eaa-2ec6126140c2 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-unplugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a56bef2c-5bf8-4a4c-b2ae-0aa20ede59b9 req-d53ff44e-3d3a-44ee-8eaa-2ec6126140c2 service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a56bef2c-5bf8-4a4c-b2ae-0aa20ede59b9 req-d53ff44e-3d3a-44ee-8eaa-2ec6126140c2 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a56bef2c-5bf8-4a4c-b2ae-0aa20ede59b9 req-d53ff44e-3d3a-44ee-8eaa-2ec6126140c2 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-a56bef2c-5bf8-4a4c-b2ae-0aa20ede59b9 req-d53ff44e-3d3a-44ee-8eaa-2ec6126140c2 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-unplugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:24 user nova-compute[74482]: WARNING nova.compute.manager [req-a56bef2c-5bf8-4a4c-b2ae-0aa20ede59b9 req-d53ff44e-3d3a-44ee-8eaa-2ec6126140c2 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-unplugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state active and task_state rescuing.
Oct 23 23:03:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 203423744 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:03:25 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Instance destroyed successfully.
Oct 23 23:03:25 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Attempting a stable device rescue
Oct 23 23:03:25 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 23:03:25 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Instance directory exists: not creating {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 23:03:25 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Creating image(s)
Oct 23 23:03:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:25 user nova-compute[74482]: DEBUG nova.objects.instance [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'trusted_certs' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:25 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 334495744 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:03:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "ddf1c67a5f2906efdb4e4f07700acd9862f644e5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "ddf1c67a5f2906efdb4e4f07700acd9862f644e5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.752s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] <== connect_volume: return (2756ms) {'type': 'block', 'scsi_wwn': '26261646363366166', 'path': '/dev/sdi'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261646363366166', 'path': '/dev/sdi'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 618659840 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.objects.instance [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lazy-loading 'flavor' on Instance uuid aa063829-b117-40f4-93f2-358b33f1d156 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:03:26 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:03:26 user nova-compute[74482]:   <source dev="/dev/sdi"/>
Oct 23 23:03:26 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:03:26 user nova-compute[74482]:   <serial>a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368</serial>
Oct 23 23:03:26 user nova-compute[74482]: </disk>
Oct 23 23:03:26 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.virt.images [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] 02270469-9f1e-456c-83d7-3b5336458d95 was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5.part /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5.part /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5.converted" returned: 0 in 0.247s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-ce7dbf0b-762c-41d4-9750-fa06aab0cad0 req-3f56b598-cb8d-4ed7-a794-7d1fd561a3ad service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ce7dbf0b-762c-41d4-9750-fa06aab0cad0 req-3f56b598-cb8d-4ed7-a794-7d1fd561a3ad service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ce7dbf0b-762c-41d4-9750-fa06aab0cad0 req-3f56b598-cb8d-4ed7-a794-7d1fd561a3ad service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ce7dbf0b-762c-41d4-9750-fa06aab0cad0 req-3f56b598-cb8d-4ed7-a794-7d1fd561a3ad service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-ce7dbf0b-762c-41d4-9750-fa06aab0cad0 req-3f56b598-cb8d-4ed7-a794-7d1fd561a3ad service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:26 user nova-compute[74482]: WARNING nova.compute.manager [req-ce7dbf0b-762c-41d4-9750-fa06aab0cad0 req-3f56b598-cb8d-4ed7-a794-7d1fd561a3ad service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state active and task_state rescuing.
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 643825664 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:03:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] No VIF found with MAC fa:16:3e:5f:07:d9, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5.converted --force-share --output=json" returned: 0 in 0.240s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "ddf1c67a5f2906efdb4e4f07700acd9862f644e5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.796s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "ddf1c67a5f2906efdb4e4f07700acd9862f644e5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "ddf1c67a5f2906efdb4e4f07700acd9862f644e5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-da72a2a8-c077-47bb-b44e-98e5075bfce0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.824s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5 --force-share --output=json" returned: 0 in 0.264s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5,backing_fmt=raw /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5,backing_fmt=raw /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue" returned: 0 in 0.067s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "ddf1c67a5f2906efdb4e4f07700acd9862f644e5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'migration_context' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.objects.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Object Instance<21d87eb6-effc-4d4f-9f31-80b8d2e15d2d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Start _get_guest_xml network_info=[{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "vif_mac": "fa:16:3e:f3:68:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '02270469-9f1e-456c-83d7-3b5336458d95', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFqUOnra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '21d87eb6-effc-4d4f-9f31-80b8d2e15d2d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e', 'serial': 'c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e'}, 'disk_bus': 'virtio', 'attachment_id': '735057ea-ebf1-43ee-83ec-f6bc7b183457', 'boot_index': None, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'resources' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 809500672 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.objects.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Object Instance<21d87eb6-effc-4d4f-9f31-80b8d2e15d2d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'numa_topology' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.objects.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Object Instance<21d87eb6-effc-4d4f-9f31-80b8d2e15d2d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:03:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:03:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'vcpu_model' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.objects.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Object Instance<21d87eb6-effc-4d4f-9f31-80b8d2e15d2d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFqUOnra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:27 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:27 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:27 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8ab7d9-14e9-4eb8-b0c0-bb97b6dac183]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DFqUOnra\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 23:03:27 user nova-compute[74482]: node.name = iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:03:27 user nova-compute[74482]: node.tpgt = -1
Oct 23 23:03:27 user nova-compute[74482]: node.startup = automatic
Oct 23 23:03:27 user nova-compute[74482]: node.leading_login = No
Oct 23 23:03:27 user nova-compute[74482]: iface.iscsi_ifacename = default
Oct 23 23:03:27 user nova-compute[74482]: iface.net_ifacename = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.ipaddress = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.prefix_len = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.hwaddress = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.transport_name = tcp
Oct 23 23:03:27 user nova-compute[74482]: iface.initiatorname = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.state = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.vlan_id = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.vlan_priority = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.vlan_state = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.iface_num = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.mtu = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.port = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.bootproto = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.subnet_mask = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.gateway = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.dhcp_alt_client_id = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.dhcp_dns = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.dhcp_learn_iqn = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.dhcp_vendor_id_state = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.dhcp_vendor_id = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.dhcp_slp_da = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.fragmentation = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.gratuitous_arp = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.incoming_forwarding = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.tos_state = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.tos = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.ttl = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.delayed_ack = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.tcp_nagle = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.tcp_wsf_state = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.tcp_wsf = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.tcp_timer_scale = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.tcp_timestamp = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.redirect = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.def_task_mgmt_timeout = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.header_digest = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.data_digest = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.immediate_data = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.initial_r2t = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.data_seq_inorder = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.data_pdu_inorder = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.erl = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.max_receive_data_len = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.first_burst_len = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.max_outstanding_r2t = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.max_burst_len = 0
Oct 23 23:03:27 user nova-compute[74482]: iface.chap_auth = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.bidi_chap = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.strict_login_compliance = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.discovery_auth = <empty>
Oct 23 23:03:27 user nova-compute[74482]: iface.discovery_logout = <empty>
Oct 23 23:03:27 user nova-compute[74482]: node.discovery_address = <empty>
Oct 23 23:03:27 user nova-compute[74482]: node.discovery_port = 0
Oct 23 23:03:27 user nova-compute[74482]: node.discovery_type = static
Oct 23 23:03:27 user nova-compute[74482]: node.session.initial_cmdsn = 0
Oct 23 23:03:27 user nova-compute[74482]: node.session.initial_login_retry_max = 8
Oct 23 23:03:27 user nova-compute[74482]: node.session.xmit_thread_priority = -20
Oct 23 23:03:27 user nova-compute[74482]: node.session.cmds_max = 128
Oct 23 23:03:27 user nova-compute[74482]: node.session.queue_depth = 32
Oct 23 23:03:27 user nova-compute[74482]: node.session.nr_sessions = 1
Oct 23 23:03:27 user nova-compute[74482]: node.session.auth.authmethod = CHAP
Oct 23 23:03:27 user nova-compute[74482]: node.session.auth.username = DFqUOnra
Oct 23 23:03:27 user nova-compute[74482]: node.session.auth.password = ***
Oct 23 23:03:27 user nova-compute[74482]: node.session.auth.username_in = <empty>
Oct 23 23:03:27 user nova-compute[74482]: node.session.auth.password_in = <empty>
Oct 23 23:03:27 user nova-compute[74482]: node.session.auth.chap_algs = MD5
Oct 23 23:03:27 user nova-compute[74482]: node.session.timeo.replacement_timeout = 120
Oct 23 23:03:27 user nova-compute[74482]: node.session.err_timeo.abort_timeout = 15
Oct 23 23:03:27 user nova-compute[74482]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 23:03:27 user nova-compute[74482]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 23:03:27 user nova-compute[74482]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.FastAbort = Yes
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.InitialR2T = No
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.ImmediateData = Yes
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.MaxConnections = 1
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 23:03:27 user nova-compute[74482]: node.session.iscsi.ERL = 0
Oct 23 23:03:27 user nova-compute[74482]: node.session.scan = manual
Oct 23 23:03:27 user nova-compute[74482]: node.session.reopen_max = 0
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].address = 172.16.0.220
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].port = 3260
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].startup = manual
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].tcp.window_size = 524288
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].tcp.type_of_service = 0
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].timeo.logout_timeout = 15
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].timeo.login_timeout = 15
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].timeo.auth_timeout = 45
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].iscsi.DataDigest = None
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].iscsi.IFMarker = No
Oct 23 23:03:27 user nova-compute[74482]: node.conn[0].iscsi.OFMarker = No
Oct 23 23:03:27 user nova-compute[74482]: # END RECORD
Oct 23 23:03:27 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e5489b-35b3-4b49-ad68-07eb8fc80e79]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d86b61-2d6d-4136-96db-a325706cda25]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFqUOnra {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DFqUOnra" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[66baf3e8-6ce7-43ac-9c09-66b9108f4808]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DFqUOnra'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d935f5-b77f-42e5-a475-2d2a0964fdb6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa6689-f1ca-4a69-bf0d-5eb8d2245634]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:27 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.218s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] HCTL ('35', '0', '0', 0) found on session 10 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80fe74f-7545-43f3-be01-59850feb007b]: (4, ('0 0 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Searching for a device in session 10 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFqUOnra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.250s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] <== connect_volume: return (252ms) {'type': 'block', 'scsi_wwn': '26636363566656534', 'path': '/dev/sdd'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636363566656534', 'path': '/dev/sdd'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:03:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 968884224 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-467597565',display_name='tempest-ServerStableDeviceRescueTest-server-467597565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-467597565',id=3,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN59euXmu5u93kXefDnMv2OWRO6hScJjvsthZe+h3yZFekwDxAtA8t7r2Cpcir9cWcpIHxhd6PIwBFk80q1czIYaN1y5u1RJOSWA5KTi76auv9na1jCQ2R/sTX0O0bDjrw==',key_name='tempest-keypair-2115897655',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d90728bc29a340049b8e038931eaf396',ramdisk_id='',reservation_id='r-19qetahm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1776446221',owner_user_name='tempest-ServerStableDeviceRescueTest-1776446221-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db64843c4a004d9fa23a275e43922494',uuid=21d87eb6-effc-4d4f-9f31-80b8d2e15d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "vif_mac": "fa:16:3e:f3:68:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Converting VIF {"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "vif_mac": "fa:16:3e:f3:68:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:68:bb,bridge_name='br-int',has_traffic_filtering=True,id=dddb3b05-0e78-459a-ae09-5db2fd55bf4c,network=Network(19346391-44d4-4db1-88f0-6561dc27559e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddb3b05-0e') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.objects.instance [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'pci_devices' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.objects.base [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Object Instance<21d87eb6-effc-4d4f-9f31-80b8d2e15d2d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:03:28 user nova-compute[74482]:   <uuid>21d87eb6-effc-4d4f-9f31-80b8d2e15d2d</uuid>
Oct 23 23:03:28 user nova-compute[74482]:   <name>instance-00000003</name>
Oct 23 23:03:28 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:03:28 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:03:28 user nova-compute[74482]:   <metadata>
Oct 23 23:03:28 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:03:28 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:03:28 user nova-compute[74482]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-467597565</nova:name>
Oct 23 23:03:28 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:03:27</nova:creationTime>
Oct 23 23:03:28 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:03:28 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:03:28 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:03:28 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:03:28 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:03:28 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:03:28 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:03:28 user nova-compute[74482]:       <nova:owner>
Oct 23 23:03:28 user nova-compute[74482]:         <nova:user uuid="db64843c4a004d9fa23a275e43922494">tempest-ServerStableDeviceRescueTest-1776446221-project-member</nova:user>
Oct 23 23:03:28 user nova-compute[74482]:         <nova:project uuid="d90728bc29a340049b8e038931eaf396">tempest-ServerStableDeviceRescueTest-1776446221</nova:project>
Oct 23 23:03:28 user nova-compute[74482]:       </nova:owner>
Oct 23 23:03:28 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:03:28 user nova-compute[74482]:       <nova:ports>
Oct 23 23:03:28 user nova-compute[74482]:         <nova:port uuid="dddb3b05-0e78-459a-ae09-5db2fd55bf4c">
Oct 23 23:03:28 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 23:03:28 user nova-compute[74482]:         </nova:port>
Oct 23 23:03:28 user nova-compute[74482]:       </nova:ports>
Oct 23 23:03:28 user nova-compute[74482]:     </nova:instance>
Oct 23 23:03:28 user nova-compute[74482]:   </metadata>
Oct 23 23:03:28 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:03:28 user nova-compute[74482]:     <system>
Oct 23 23:03:28 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:03:28 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:03:28 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:03:28 user nova-compute[74482]:       <entry name="serial">21d87eb6-effc-4d4f-9f31-80b8d2e15d2d</entry>
Oct 23 23:03:28 user nova-compute[74482]:       <entry name="uuid">21d87eb6-effc-4d4f-9f31-80b8d2e15d2d</entry>
Oct 23 23:03:28 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:03:28 user nova-compute[74482]:     </system>
Oct 23 23:03:28 user nova-compute[74482]:   </sysinfo>
Oct 23 23:03:28 user nova-compute[74482]:   <os>
Oct 23 23:03:28 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:03:28 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:03:28 user nova-compute[74482]:   </os>
Oct 23 23:03:28 user nova-compute[74482]:   <features>
Oct 23 23:03:28 user nova-compute[74482]:     <acpi/>
Oct 23 23:03:28 user nova-compute[74482]:     <apic/>
Oct 23 23:03:28 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:03:28 user nova-compute[74482]:   </features>
Oct 23 23:03:28 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:03:28 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:03:28 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:03:28 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:03:28 user nova-compute[74482]:   </clock>
Oct 23 23:03:28 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:03:28 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:03:28 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:03:28 user nova-compute[74482]:   </cpu>
Oct 23 23:03:28 user nova-compute[74482]:   <devices>
Oct 23 23:03:28 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:03:28 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:03:28 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk"/>
Oct 23 23:03:28 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:03:28 user nova-compute[74482]:     </disk>
Oct 23 23:03:28 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:03:28 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:03:28 user nova-compute[74482]:       <source dev="/dev/sdd"/>
Oct 23 23:03:28 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:03:28 user nova-compute[74482]:       <serial>c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e</serial>
Oct 23 23:03:28 user nova-compute[74482]:     </disk>
Oct 23 23:03:28 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:03:28 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:03:28 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue"/>
Oct 23 23:03:28 user nova-compute[74482]:       <target dev="vdc" bus="virtio"/>
Oct 23 23:03:28 user nova-compute[74482]:       <boot order="1"/>
Oct 23 23:03:28 user nova-compute[74482]:     </disk>
Oct 23 23:03:28 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:03:28 user nova-compute[74482]:       <mac address="fa:16:3e:f3:68:bb"/>
Oct 23 23:03:28 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:03:28 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:03:28 user nova-compute[74482]:       <target dev="tapdddb3b05-0e"/>
Oct 23 23:03:28 user nova-compute[74482]:     </interface>
Oct 23 23:03:28 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:03:28 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/console.log" append="off"/>
Oct 23 23:03:28 user nova-compute[74482]:     </serial>
Oct 23 23:03:28 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:03:28 user nova-compute[74482]:     <video>
Oct 23 23:03:28 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:03:28 user nova-compute[74482]:     </video>
Oct 23 23:03:28 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:03:28 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:03:28 user nova-compute[74482]:     </rng>
Oct 23 23:03:28 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:03:28 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:03:28 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:03:28 user nova-compute[74482]:     </memballoon>
Oct 23 23:03:28 user nova-compute[74482]:   </devices>
Oct 23 23:03:28 user nova-compute[74482]: </domain>
Oct 23 23:03:28 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:03:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Instance destroyed successfully.
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] No VIF found with MAC fa:16:3e:f3:68:bb, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:03:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmfDFHRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:29 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370753f-c0a3-4e80-b3eb-2cb3a40d31f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:03:29 user nova-compute[74482]: No targets found.
Oct 23 23:03:29 user nova-compute[74482]: iSNS:
Oct 23 23:03:29 user nova-compute[74482]: No targets found.
Oct 23 23:03:29 user nova-compute[74482]: STATIC:
Oct 23 23:03:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e
Oct 23 23:03:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:29 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455
Oct 23 23:03:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:29 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7
Oct 23 23:03:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:29 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe
Oct 23 23:03:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:29 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:03:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:29 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39
Oct 23 23:03:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:29 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:03:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:29 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:03:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:29 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:29 user nova-compute[74482]: FIRMWARE:
Oct 23 23:03:29 user nova-compute[74482]: No targets found.
Oct 23 23:03:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:03:29 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:03:29 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[40db0c74-869f-4e8b-8138-563eb02148fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b642fd-27bc-47ac-a6bc-5c8767f51ef5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 (non-flash)
Oct 23 23:03:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c493490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39'): ({'sdg'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Removing single pathed devices sdg {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77183f2-2be0-4acb-a150-320cb80a03b5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc41a12-4f9b-46b8-9e0e-3c8dda214d0b]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Flushing IO for device /dev/sdg {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a1cc44-beea-46c4-b1cf-623792dc6784]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fddfc9-3008-4cfd-a0af-c58013c5a18e]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] SCSI volumes sdg have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d8fa82-ff2a-45d9-8337-3c5711ff9abe]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[556aed81-c2f1-468b-b5b2-d62e3c955b80]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39, portal: 172.16.0.220,3260]
Oct 23 23:03:29 user nova-compute[74482]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39, portal: 172.16.0.220,3260] successful.
Oct 23 23:03:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1ad973-6f41-4bf5-8681-c4c5fa10e389]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] <== disconnect_volume: return (378ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIMeiUcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'e8bdfd0e-24d2-4f31-a650-60edac47fc97', 'attached_at': '', 'detached_at': '', 'volume_id': '9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'serial'} {{(pid=74482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 23 23:03:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] swap_volume: removing Cinder connection for volume 3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 {{(pid=74482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-8a08b2f4-61ae-4a0c-8d85-ea79fc5558b1 req-f7197c04-09f5-424b-a342-5388f8642cfe service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8a08b2f4-61ae-4a0c-8d85-ea79fc5558b1 req-f7197c04-09f5-424b-a342-5388f8642cfe service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8a08b2f4-61ae-4a0c-8d85-ea79fc5558b1 req-f7197c04-09f5-424b-a342-5388f8642cfe service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8a08b2f4-61ae-4a0c-8d85-ea79fc5558b1 req-f7197c04-09f5-424b-a342-5388f8642cfe service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-8a08b2f4-61ae-4a0c-8d85-ea79fc5558b1 req-f7197c04-09f5-424b-a342-5388f8642cfe service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:30 user nova-compute[74482]: WARNING nova.compute.manager [req-8a08b2f4-61ae-4a0c-8d85-ea79fc5558b1 req-f7197c04-09f5-424b-a342-5388f8642cfe service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state active and task_state rescuing.
Oct 23 23:03:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Stashing vm_state: active {{(pid=74482) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:03:30 user nova-compute[74482]: INFO nova.compute.claims [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Claim successful on node user
Oct 23 23:03:30 user nova-compute[74482]: INFO nova.compute.resource_tracker [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating resource usage from migration 1038afda-29ba-4303-9327-eb047061724b
Oct 23 23:03:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] swap_volume: Updating volume 3d4701b7-6feb-4b49-9d63-c4d0b3b2eb39 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "XIMeiUcp", "auth_password": "aO9tefYMC3hVvu", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "9e098ec9-c890-45b4-8dbb-3eb0126d9d7e"}, "status": "reserved", "instance": "e8bdfd0e-24d2-4f31-a650-60edac47fc97", "attached_at": "", "detached_at": "", "volume_id": "9e098ec9-c890-45b4-8dbb-3eb0126d9d7e", "serial": "9e098ec9-c890-45b4-8dbb-3eb0126d9d7e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'no_device': None, 'attachment_id': '15e822c1-15ee-49d3-a7a6-229fabef708d'} {{(pid=74482) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a81b2054-3fb9-4adc-89c3-65a2a118ddd1 tempest-TestVolumeSwap-2040766127 tempest-TestVolumeSwap-2040766127-project-admin] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 32.879s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.539s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:31 user nova-compute[74482]: INFO nova.compute.manager [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Migrating
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:03:31 user nova-compute[74482]: INFO nova.compute.rpcapi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquired lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance_info_cache with network_info: [{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Releasing lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:31 user nova-compute[74482]: INFO nova.compute.manager [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Detaching volume 9e098ec9-c890-45b4-8dbb-3eb0126d9d7e
Oct 23 23:03:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Starting migrate_disk_and_power_off {{(pid=74482) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 23 23:03:31 user nova-compute[74482]: INFO nova.virt.block_device [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Attempting to driver detach volume 9e098ec9-c890-45b4-8dbb-3eb0126d9d7e from mountpoint /dev/vdb
Oct 23 23:03:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Attempting to detach device vdb from instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:03:31 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:03:31 user nova-compute[74482]:   <source dev="/dev/sdh"/>
Oct 23 23:03:31 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:03:31 user nova-compute[74482]:   <serial>9e098ec9-c890-45b4-8dbb-3eb0126d9d7e</serial>
Oct 23 23:03:31 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:03:31 user nova-compute[74482]: </disk>
Oct 23 23:03:31 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:03:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Successfully detached device vdb from instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 from the persistent domain config.
Oct 23 23:03:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:03:32 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:03:32 user nova-compute[74482]:   <source dev="/dev/sdh"/>
Oct 23 23:03:32 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:03:32 user nova-compute[74482]:   <serial>9e098ec9-c890-45b4-8dbb-3eb0126d9d7e</serial>
Oct 23 23:03:32 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:03:32 user nova-compute[74482]: </disk>
Oct 23 23:03:32 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-69ff70b9-7641-478b-bfb6-5d9585bb2846 req-f294c106-9bd4-4f96-8fb6-c3dde2a8e645 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-69ff70b9-7641-478b-bfb6-5d9585bb2846 req-f294c106-9bd4-4f96-8fb6-c3dde2a8e645 service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-69ff70b9-7641-478b-bfb6-5d9585bb2846 req-f294c106-9bd4-4f96-8fb6-c3dde2a8e645 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-69ff70b9-7641-478b-bfb6-5d9585bb2846 req-f294c106-9bd4-4f96-8fb6-c3dde2a8e645 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-69ff70b9-7641-478b-bfb6-5d9585bb2846 req-f294c106-9bd4-4f96-8fb6-c3dde2a8e645 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:32 user nova-compute[74482]: WARNING nova.compute.manager [req-69ff70b9-7641-478b-bfb6-5d9585bb2846 req-f294c106-9bd4-4f96-8fb6-c3dde2a8e645 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state active and task_state rescuing.
Oct 23 23:03:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-6859e34e-de5a-4b9f-9a53-d61fafe299f3 req-b4b82598-e779-4035-944a-c5bffa0ee4be service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6859e34e-de5a-4b9f-9a53-d61fafe299f3 req-b4b82598-e779-4035-944a-c5bffa0ee4be service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6859e34e-de5a-4b9f-9a53-d61fafe299f3 req-b4b82598-e779-4035-944a-c5bffa0ee4be service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6859e34e-de5a-4b9f-9a53-d61fafe299f3 req-b4b82598-e779-4035-944a-c5bffa0ee4be service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-6859e34e-de5a-4b9f-9a53-d61fafe299f3 req-b4b82598-e779-4035-944a-c5bffa0ee4be service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:32 user nova-compute[74482]: WARNING nova.compute.manager [req-6859e34e-de5a-4b9f-9a53-d61fafe299f3 req-b4b82598-e779-4035-944a-c5bffa0ee4be service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state active and task_state resize_migrating.
Oct 23 23:03:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-16a1b9ed-262d-49e1-a033-b2bd0dac0568 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:32 user nova-compute[74482]: INFO nova.compute.manager [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Terminating instance
Oct 23 23:03:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance destroyed successfully.
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1895303322',display_name='tempest-ServerActionsTestOtherB-server-1895303322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1895303322',id=2,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtTCYnjLWuZ5ND071jtsoNL+jCbUBIt9fx3Xpn4EVHhYK3Fa774GNC5Gw1NBdqzVTnVApUJDfyn5fEVDoKQTbN3TLPt6wiaiOSOkoESIbi/mWxf/f66vq9c/4Twd5CY7Q==',key_name='tempest-keypair-2026660343',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69039bafbadf4db8862003e2483fc973',ramdisk_id='',reservation_id='r-ejmhk03v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-598393554',owner_user_name='tempest-ServerActionsTestOtherB-598393554-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad45a40b18f4217924249b71fd4c93d',uuid=aa063829-b117-40f4-93f2-358b33f1d156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-98793107-network", "vif_mac": "fa:16:3e:5f:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converting VIF {"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-98793107-network", "vif_mac": "fa:16:3e:5f:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_vif [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26dfbe86-37, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a53e3223-b212-4cfc-84d7-dde7a6d0a4c7) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: INFO os_vif [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37')
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:33 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b8698d-7af9-4039-a9d2-cd1564ac8a98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:03:33 user nova-compute[74482]: No targets found.
Oct 23 23:03:33 user nova-compute[74482]: iSNS:
Oct 23 23:03:33 user nova-compute[74482]: No targets found.
Oct 23 23:03:33 user nova-compute[74482]: STATIC:
Oct 23 23:03:33 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e
Oct 23 23:03:33 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:33 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:33 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455
Oct 23 23:03:33 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:33 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:33 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7
Oct 23 23:03:33 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:33 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:33 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe
Oct 23 23:03:33 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:33 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:33 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:03:33 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:33 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:33 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:03:33 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:33 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:33 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:03:33 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:33 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:33 user nova-compute[74482]: FIRMWARE:
Oct 23 23:03:33 user nova-compute[74482]: No targets found.
Oct 23 23:03:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:03:33 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:03:33 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6243b14-95a5-4fda-8bf1-551f4914f7b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[55201193-5a9a-4fc8-bb2e-0eea3919de33]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:33 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c5bb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368'): ({'sdi'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Removing single pathed devices sdi {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b462fb-2ead-4452-9322-e6d010fc2f11]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[912a1cba-7ffd-4ea7-86e9-811ef32e1e4c]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Flushing IO for device /dev/sdi {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb87050-ec3d-466c-b0f1-fdff1b470655]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[680ce369-9744-4f45-9bcc-4585b26fc9de]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] SCSI volumes sdi have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f344839-24f6-4c3b-888d-070ca05f83cb]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beefd24-c542-4624-87c2-e742d963c562]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]
Oct 23 23:03:33 user nova-compute[74482]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.
Oct 23 23:03:33 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Instance destroyed successfully.
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.objects.instance [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lazy-loading 'resources' on Instance uuid 903923e6-8faa-4c46-9b5f-1b611f6902dc {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1961202639',display_name='tempest-VolumesAssistedSnapshotsTest-server-1961202639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1961202639',id=9,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeaKDfacBidYuwA3kgr4qYef57CgbIJ/kF3oDmojQ00Y90Q9NkNoKWf4t3Kdwx1ju/kATrq9OJ/Y1NJQIZpauQgeCW2M7IklsUBSzrEotHuooqTN6mJhob82OKVzdyBXA==',key_name='tempest-keypair-1690234251',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:00:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbfcf38ea83f473c8aeb37253e9deb4a',ramdisk_id='',reservation_id='r-elmev2al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1397661992',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1397661992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='439d4186957c4d7780483480461b7322',uuid=903923e6-8faa-4c46-9b5f-1b611f6902dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Converting VIF {"id": "4d273b5c-85c1-42f9-b31a-321932d97e42", "address": "fa:16:3e:7a:9c:23", "network": {"id": "0760bf31-70d9-48fd-8398-48e0440eabf6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-249599662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbfcf38ea83f473c8aeb37253e9deb4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d273b5c-85", "ovs_interfaceid": "4d273b5c-85c1-42f9-b31a-321932d97e42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=4d273b5c-85c1-42f9-b31a-321932d97e42,network=Network(0760bf31-70d9-48fd-8398-48e0440eabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d273b5c-85') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_vif [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=4d273b5c-85c1-42f9-b31a-321932d97e42,network=Network(0760bf31-70d9-48fd-8398-48e0440eabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d273b5c-85') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d273b5c-85, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[992c6094-fb0e-4f88-8324-bb51618bc664]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] <== disconnect_volume: return (403ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73dd4bb1-e381-443b-beb0-49e612355196) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: INFO os_vif [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:9c:23,bridge_name='br-int',has_traffic_filtering=True,id=4d273b5c-85c1-42f9-b31a-321932d97e42,network=Network(0760bf31-70d9-48fd-8398-48e0440eabf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d273b5c-85')
Oct 23 23:03:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Deleting instance files /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc_del
Oct 23 23:03:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Deletion of /opt/stack/data/nova/instances/903923e6-8faa-4c46-9b5f-1b611f6902dc_del complete
Oct 23 23:03:33 user nova-compute[74482]: INFO nova.compute.manager [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:03:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156_resize/disk /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:34 user nova-compute[74482]: WARNING nova.compute.manager [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state active and task_state resize_migrating.
Oct 23 23:03:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received event network-vif-unplugged-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] No waiting events found dispatching network-vif-unplugged-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received event network-vif-unplugged-4d273b5c-85c1-42f9-b31a-321932d97e42 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received event network-vif-plugged-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] Acquiring lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] No waiting events found dispatching network-vif-plugged-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:03:34 user nova-compute[74482]: WARNING nova.compute.manager [req-0b5c8e68-42a4-443d-ab26-5a4926cbef7b req-4c68cb2b-566a-4e19-99df-24e512a998f5 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received unexpected event network-vif-plugged-4d273b5c-85c1-42f9-b31a-321932d97e42 for instance with vm_state active and task_state deleting.
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "cp -r /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156_resize/disk /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk" returned: 0 in 0.421s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156_resize/disk.info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk.info {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "cp -r /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156_resize/disk.info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk.info" returned: 0 in 0.044s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:03:34 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Took 0.93 seconds to deallocate network for instance.
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:35 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:03:35 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:03:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:35 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Deleted allocations for instance 903923e6-8faa-4c46-9b5f-1b611f6902dc
Oct 23 23:03:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-04316b0b-7490-4796-8256-2286a61f8e0f tempest-VolumesAssistedSnapshotsTest-1397661992 tempest-VolumesAssistedSnapshotsTest-1397661992-project-member] Lock "903923e6-8faa-4c46-9b5f-1b611f6902dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Port 26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 binding to destination host user is already ACTIVE {{(pid=74482) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquired lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-6edc554e-6efe-4c47-bec0-10368e1bf3cb req-599ad44c-575b-4af4-8194-39819f9264f4 service nova] [instance: 903923e6-8faa-4c46-9b5f-1b611f6902dc] Received event network-vif-deleted-4d273b5c-85c1-42f9-b31a-321932d97e42 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance_info_cache with network_info: [{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Releasing lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG os_brick.utils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8ba219-0be5-4271-a7fb-94dcb671b0db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade6f81f-0bf8-45de-90ef-1392c98b685c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7708d73-9f9a-4690-9853-d7bab0368553]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62fa47-c7e4-406a-aca9-752235e19ffa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:03:37 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:03:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b71d5ca-b80c-4f41-8212-71646e057be8]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG os_brick.utils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:03:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:52 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 is timed out.
Oct 23 23:03:52 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Successfully detached device vdb from instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 from the live domain config.
Oct 23 23:03:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIMeiUcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '9e098ec9-c890-45b4-8dbb-3eb0126d9d7e'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:52 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb368beb-26f6-4d7d-a9ae-dca682cc5481]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:03:52 user nova-compute[74482]: No targets found.
Oct 23 23:03:52 user nova-compute[74482]: iSNS:
Oct 23 23:03:52 user nova-compute[74482]: No targets found.
Oct 23 23:03:52 user nova-compute[74482]: STATIC:
Oct 23 23:03:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e
Oct 23 23:03:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455
Oct 23 23:03:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7
Oct 23 23:03:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe
Oct 23 23:03:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:03:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:03:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:03:52 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:03:52 user nova-compute[74482]: FIRMWARE:
Oct 23 23:03:52 user nova-compute[74482]: No targets found.
Oct 23 23:03:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:03:52 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:03:52 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de8133f-d8c5-4191-a605-00625e3965c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec8354-5a90-40f2-a017-ff82b6f92fa1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:52 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f304c7c0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e'): ({'sdh'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Removing single pathed devices sdh {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cef193-956d-4584-8769-3fba4584675a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e2eee-2e7a-496f-bd9e-93eddaf35e74]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Flushing IO for device /dev/sdh {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e412f9-0fad-4b19-9798-38db703d126f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.057s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a35b2c-3ddc-4a8a-b942-3c36dd35b0d7]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] SCSI volumes sdh have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc52832f-c2a8-44f9-9fe4-f9d5d6718e5c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18543f3-debc-42a6-b87d-95bec2f435c9]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260]
Oct 23 23:03:52 user nova-compute[74482]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e, portal: 172.16.0.220,3260] successful.
Oct 23 23:03:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e098ec9-c890-45b4-8dbb-3eb0126d9d7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[722f40d5-adcd-4806-a34d-e61ffaf24977]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] <== disconnect_volume: return (389ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:03:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:03:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:54 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lazy-loading 'flavor' on Instance uuid e8bdfd0e-24d2-4f31-a650-60edac47fc97 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:03:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a4de3ec7-abcc-48fe-afb3-2cbae40a997a tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.257s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Starting finish_migration {{(pid=74482) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 23 23:03:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance directory exists: not creating {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 23:03:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Creating image(s)
Oct 23 23:03:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:03:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:58 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk. size=21474836480 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:03:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk 21474836480 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk 21474836480" returned: 0 in 0.050s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Ensure instance console log exists: /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Start _get_guest_xml network_info=[{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-98793107-network", "vif_mac": "fa:16:3e:5f:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'aa063829-b117-40f4-93f2-358b33f1d156', 'attached_at': '2023-10-23T23:03:58.000000', 'detached_at': '', 'volume_id': 'a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'serial': 'a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368'}, 'disk_bus': 'virtio', 'attachment_id': 'f8e1c9f4-398e-4c93-8321-08cca4696c7d', 'boot_index': None, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:03:59 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:03:59 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:03:59 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:59 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:03:59 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ea606f-2d4e-4bad-b211-84e2cf1f70a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:03:59 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f4f53-e477-4cf0-9864-c8daf59712fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368] added
Oct 23 23:03:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[512923e3-ce4a-43d4-a69e-a358f7ea317d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae08ff-9cc3-44df-935c-0723e3a20c8d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrQcGyOU {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrQcGyOU" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2246ced8-f005-4dbd-a420-1e1ec64f4649]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZrQcGyOU'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ae989-5521-4531-851d-723e97b8b982]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa8d588-53bd-45b2-a0a1-8b7272cd6a5a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[12123115-bd1b-4b42-8524-6e22ac01fc70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]
Oct 23 23:03:59 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.
Oct 23 23:03:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d784d04b-6118-4ce5-bf34-99b1f476fc50]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f4645-b164-4560-8087-a1b659b1f411]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:03:59 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:03:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b709db4b-2536-4d10-8bda-968724aec6cd]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:03:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26261646363366166', 'path': '/dev/sdg'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261646363366166', 'path': '/dev/sdg'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1895303322',display_name='tempest-ServerActionsTestOtherB-server-1895303322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1895303322',id=2,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtTCYnjLWuZ5ND071jtsoNL+jCbUBIt9fx3Xpn4EVHhYK3Fa774GNC5Gw1NBdqzVTnVApUJDfyn5fEVDoKQTbN3TLPt6wiaiOSOkoESIbi/mWxf/f66vq9c/4Twd5CY7Q==',key_name='tempest-keypair-2026660343',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69039bafbadf4db8862003e2483fc973',ramdisk_id='',reservation_id='r-ejmhk03v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-598393554',owner_user_name='tempest-ServerActionsTestOtherB-598393554-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad45a40b18f4217924249b71fd4c93d',uuid=aa063829-b117-40f4-93f2-358b33f1d156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-98793107-network", "vif_mac": "fa:16:3e:5f:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converting VIF {"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-98793107-network", "vif_mac": "fa:16:3e:5f:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:04:00 user nova-compute[74482]:   <uuid>aa063829-b117-40f4-93f2-358b33f1d156</uuid>
Oct 23 23:04:00 user nova-compute[74482]:   <name>instance-00000002</name>
Oct 23 23:04:00 user nova-compute[74482]:   <memory>2097152</memory>
Oct 23 23:04:00 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:04:00 user nova-compute[74482]:   <metadata>
Oct 23 23:04:00 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:04:00 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:04:00 user nova-compute[74482]:       <nova:name>tempest-ServerActionsTestOtherB-server-1895303322</nova:name>
Oct 23 23:04:00 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:03:59</nova:creationTime>
Oct 23 23:04:00 user nova-compute[74482]:       <nova:flavor name="m1.small">
Oct 23 23:04:00 user nova-compute[74482]:         <nova:memory>2048</nova:memory>
Oct 23 23:04:00 user nova-compute[74482]:         <nova:disk>20</nova:disk>
Oct 23 23:04:00 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:04:00 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:04:00 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:04:00 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:04:00 user nova-compute[74482]:       <nova:owner>
Oct 23 23:04:00 user nova-compute[74482]:         <nova:user uuid="8ad45a40b18f4217924249b71fd4c93d">tempest-ServerActionsTestOtherB-598393554-project-member</nova:user>
Oct 23 23:04:00 user nova-compute[74482]:         <nova:project uuid="69039bafbadf4db8862003e2483fc973">tempest-ServerActionsTestOtherB-598393554</nova:project>
Oct 23 23:04:00 user nova-compute[74482]:       </nova:owner>
Oct 23 23:04:00 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:04:00 user nova-compute[74482]:       <nova:ports>
Oct 23 23:04:00 user nova-compute[74482]:         <nova:port uuid="26dfbe86-3706-4d55-8a27-3e7d97ffbaa3">
Oct 23 23:04:00 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 23:04:00 user nova-compute[74482]:         </nova:port>
Oct 23 23:04:00 user nova-compute[74482]:       </nova:ports>
Oct 23 23:04:00 user nova-compute[74482]:     </nova:instance>
Oct 23 23:04:00 user nova-compute[74482]:   </metadata>
Oct 23 23:04:00 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:04:00 user nova-compute[74482]:     <system>
Oct 23 23:04:00 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:04:00 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:04:00 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:04:00 user nova-compute[74482]:       <entry name="serial">aa063829-b117-40f4-93f2-358b33f1d156</entry>
Oct 23 23:04:00 user nova-compute[74482]:       <entry name="uuid">aa063829-b117-40f4-93f2-358b33f1d156</entry>
Oct 23 23:04:00 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:04:00 user nova-compute[74482]:     </system>
Oct 23 23:04:00 user nova-compute[74482]:   </sysinfo>
Oct 23 23:04:00 user nova-compute[74482]:   <os>
Oct 23 23:04:00 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:04:00 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:04:00 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:04:00 user nova-compute[74482]:   </os>
Oct 23 23:04:00 user nova-compute[74482]:   <features>
Oct 23 23:04:00 user nova-compute[74482]:     <acpi/>
Oct 23 23:04:00 user nova-compute[74482]:     <apic/>
Oct 23 23:04:00 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:04:00 user nova-compute[74482]:   </features>
Oct 23 23:04:00 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:04:00 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:04:00 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:04:00 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:04:00 user nova-compute[74482]:   </clock>
Oct 23 23:04:00 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:04:00 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:04:00 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:04:00 user nova-compute[74482]:   </cpu>
Oct 23 23:04:00 user nova-compute[74482]:   <devices>
Oct 23 23:04:00 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:04:00 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:04:00 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk"/>
Oct 23 23:04:00 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:04:00 user nova-compute[74482]:     </disk>
Oct 23 23:04:00 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:04:00 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:04:00 user nova-compute[74482]:       <source dev="/dev/sdg"/>
Oct 23 23:04:00 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:04:00 user nova-compute[74482]:       <serial>a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368</serial>
Oct 23 23:04:00 user nova-compute[74482]:     </disk>
Oct 23 23:04:00 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:04:00 user nova-compute[74482]:       <mac address="fa:16:3e:5f:07:d9"/>
Oct 23 23:04:00 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:00 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:04:00 user nova-compute[74482]:       <target dev="tap26dfbe86-37"/>
Oct 23 23:04:00 user nova-compute[74482]:     </interface>
Oct 23 23:04:00 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:04:00 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/console.log" append="off"/>
Oct 23 23:04:00 user nova-compute[74482]:     </serial>
Oct 23 23:04:00 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:04:00 user nova-compute[74482]:     <video>
Oct 23 23:04:00 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:00 user nova-compute[74482]:     </video>
Oct 23 23:04:00 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:04:00 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:04:00 user nova-compute[74482]:     </rng>
Oct 23 23:04:00 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:04:00 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:04:00 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:04:00 user nova-compute[74482]:     </memballoon>
Oct 23 23:04:00 user nova-compute[74482]:   </devices>
Oct 23 23:04:00 user nova-compute[74482]: </domain>
Oct 23 23:04:00 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1895303322',display_name='tempest-ServerActionsTestOtherB-server-1895303322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1895303322',id=2,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtTCYnjLWuZ5ND071jtsoNL+jCbUBIt9fx3Xpn4EVHhYK3Fa774GNC5Gw1NBdqzVTnVApUJDfyn5fEVDoKQTbN3TLPt6wiaiOSOkoESIbi/mWxf/f66vq9c/4Twd5CY7Q==',key_name='tempest-keypair-2026660343',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69039bafbadf4db8862003e2483fc973',ramdisk_id='',reservation_id='r-ejmhk03v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-598393554',owner_user_name='tempest-ServerActionsTestOtherB-598393554-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad45a40b18f4217924249b71fd4c93d',uuid=aa063829-b117-40f4-93f2-358b33f1d156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-98793107-network", "vif_mac": "fa:16:3e:5f:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converting VIF {"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-98793107-network", "vif_mac": "fa:16:3e:5f:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG os_vif [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '555976a0-e423-5268-b7e5-36fd51a4a60e', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26dfbe86-37, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26dfbe86-37, col_values=(('qos', UUID('ab8b01d8-c393-44de-80f3-5d3dd587d718')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26dfbe86-37, col_values=(('external_ids', {'iface-id': '26dfbe86-3706-4d55-8a27-3e7d97ffbaa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:07:d9', 'vm-uuid': 'aa063829-b117-40f4-93f2-358b33f1d156'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:00 user nova-compute[74482]: INFO os_vif [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37')
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:04:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] No VIF found with MAC fa:16:3e:5f:07:d9, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:04:01 user nova-compute[74482]: INFO nova.compute.manager [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Rescuing
Oct 23 23:04:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:04:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquired lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:04:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:04:01 user nova-compute[74482]: INFO nova.compute.manager [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Rescuing
Oct 23 23:04:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:04:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquired lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:04:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:04:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updating instance_info_cache with network_info: [{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Releasing lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-69e09d26-8300-4a83-809c-77955540b78c req-55691d33-af38-43f4-9a88-adb39da7487f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-69e09d26-8300-4a83-809c-77955540b78c req-55691d33-af38-43f4-9a88-adb39da7487f service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-69e09d26-8300-4a83-809c-77955540b78c req-55691d33-af38-43f4-9a88-adb39da7487f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-69e09d26-8300-4a83-809c-77955540b78c req-55691d33-af38-43f4-9a88-adb39da7487f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-69e09d26-8300-4a83-809c-77955540b78c req-55691d33-af38-43f4-9a88-adb39da7487f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:02 user nova-compute[74482]: WARNING nova.compute.manager [req-69e09d26-8300-4a83-809c-77955540b78c req-55691d33-af38-43f4-9a88-adb39da7487f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state active and task_state resize_finish.
Oct 23 23:04:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updating instance_info_cache with network_info: [{"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Releasing lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:02 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Instance destroyed successfully.
Oct 23 23:04:02 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Attempting rescue
Oct 23 23:04:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Instance directory exists: not creating {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 23:04:02 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Creating image(s)
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.221s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue" returned: 0 in 0.059s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'migration_context' on Instance uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.base [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<2c51493a-92fc-4297-9ba9-8ee2770c8eb0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Start _get_guest_xml network_info=[{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "vif_mac": "fa:16:3e:08:ee:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8269c4ae-64d4-478e-8976-b601953bda88', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'resources' on Instance uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.base [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<2c51493a-92fc-4297-9ba9-8ee2770c8eb0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.base [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<2c51493a-92fc-4297-9ba9-8ee2770c8eb0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:03 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:03 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.base [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<2c51493a-92fc-4297-9ba9-8ee2770c8eb0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-906590860',display_name='tempest-ServerRescueNegativeTestJSON-server-906590860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-906590860',id=4,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-q5yfdo5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:59:33Z,user_data=None,user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=2c51493a-92fc-4297-9ba9-8ee2770c8eb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "vif_mac": "fa:16:3e:08:ee:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "vif_mac": "fa:16:3e:08:ee:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:ee:5b,bridge_name='br-int',has_traffic_filtering=True,id=26004c78-273a-4649-818c-2cd38fd8bcbc,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26004c78-27') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.base [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<2c51493a-92fc-4297-9ba9-8ee2770c8eb0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:04:03 user nova-compute[74482]:   <uuid>2c51493a-92fc-4297-9ba9-8ee2770c8eb0</uuid>
Oct 23 23:04:03 user nova-compute[74482]:   <name>instance-00000004</name>
Oct 23 23:04:03 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:04:03 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:04:03 user nova-compute[74482]:   <metadata>
Oct 23 23:04:03 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:04:03 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:04:03 user nova-compute[74482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-906590860</nova:name>
Oct 23 23:04:03 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:04:03</nova:creationTime>
Oct 23 23:04:03 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:04:03 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:04:03 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:04:03 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:04:03 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:04:03 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:04:03 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:04:03 user nova-compute[74482]:       <nova:owner>
Oct 23 23:04:03 user nova-compute[74482]:         <nova:user uuid="2dfe9260c1b8446fbcda07a9dcfa65fb">tempest-ServerRescueNegativeTestJSON-1888569284-project-member</nova:user>
Oct 23 23:04:03 user nova-compute[74482]:         <nova:project uuid="c07328e2befa472d804361a59ac16829">tempest-ServerRescueNegativeTestJSON-1888569284</nova:project>
Oct 23 23:04:03 user nova-compute[74482]:       </nova:owner>
Oct 23 23:04:03 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:04:03 user nova-compute[74482]:       <nova:ports>
Oct 23 23:04:03 user nova-compute[74482]:         <nova:port uuid="26004c78-273a-4649-818c-2cd38fd8bcbc">
Oct 23 23:04:03 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 23:04:03 user nova-compute[74482]:         </nova:port>
Oct 23 23:04:03 user nova-compute[74482]:       </nova:ports>
Oct 23 23:04:03 user nova-compute[74482]:     </nova:instance>
Oct 23 23:04:03 user nova-compute[74482]:   </metadata>
Oct 23 23:04:03 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:04:03 user nova-compute[74482]:     <system>
Oct 23 23:04:03 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:04:03 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:04:03 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:04:03 user nova-compute[74482]:       <entry name="serial">2c51493a-92fc-4297-9ba9-8ee2770c8eb0</entry>
Oct 23 23:04:03 user nova-compute[74482]:       <entry name="uuid">2c51493a-92fc-4297-9ba9-8ee2770c8eb0</entry>
Oct 23 23:04:03 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:04:03 user nova-compute[74482]:     </system>
Oct 23 23:04:03 user nova-compute[74482]:   </sysinfo>
Oct 23 23:04:03 user nova-compute[74482]:   <os>
Oct 23 23:04:03 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:04:03 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:04:03 user nova-compute[74482]:   </os>
Oct 23 23:04:03 user nova-compute[74482]:   <features>
Oct 23 23:04:03 user nova-compute[74482]:     <acpi/>
Oct 23 23:04:03 user nova-compute[74482]:     <apic/>
Oct 23 23:04:03 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:04:03 user nova-compute[74482]:   </features>
Oct 23 23:04:03 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:04:03 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:04:03 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:04:03 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:04:03 user nova-compute[74482]:   </clock>
Oct 23 23:04:03 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:04:03 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:04:03 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:04:03 user nova-compute[74482]:   </cpu>
Oct 23 23:04:03 user nova-compute[74482]:   <devices>
Oct 23 23:04:03 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:04:03 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:04:03 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue"/>
Oct 23 23:04:03 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:04:03 user nova-compute[74482]:     </disk>
Oct 23 23:04:03 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:04:03 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:04:03 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk"/>
Oct 23 23:04:03 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:04:03 user nova-compute[74482]:     </disk>
Oct 23 23:04:03 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:04:03 user nova-compute[74482]:       <mac address="fa:16:3e:08:ee:5b"/>
Oct 23 23:04:03 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:03 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:04:03 user nova-compute[74482]:       <target dev="tap26004c78-27"/>
Oct 23 23:04:03 user nova-compute[74482]:     </interface>
Oct 23 23:04:03 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:04:03 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/console.log" append="off"/>
Oct 23 23:04:03 user nova-compute[74482]:     </serial>
Oct 23 23:04:03 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:04:03 user nova-compute[74482]:     <video>
Oct 23 23:04:03 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:03 user nova-compute[74482]:     </video>
Oct 23 23:04:03 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:04:03 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:04:03 user nova-compute[74482]:     </rng>
Oct 23 23:04:03 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:04:03 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:04:03 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:04:03 user nova-compute[74482]:     </memballoon>
Oct 23 23:04:03 user nova-compute[74482]:   </devices>
Oct 23 23:04:03 user nova-compute[74482]: </domain>
Oct 23 23:04:03 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:04:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Instance destroyed successfully.
Oct 23 23:04:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Instance destroyed successfully.
Oct 23 23:04:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Attempting a stable device rescue
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No VIF found with MAC fa:16:3e:08:ee:5b, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Instance directory exists: not creating {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 23:04:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Creating image(s)
Oct 23 23:04:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "/opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "/opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'trusted_certs' on Instance uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "f5b23a38bcf5d7a6375a0957139d966fe58252ba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "f5b23a38bcf5d7a6375a0957139d966fe58252ba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:04 user nova-compute[74482]: WARNING nova.compute.manager [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state active and task_state resize_finish.
Oct 23 23:04:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-unplugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-unplugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:04 user nova-compute[74482]: WARNING nova.compute.manager [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-unplugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state active and task_state rescuing.
Oct 23 23:04:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:04 user nova-compute[74482]: WARNING nova.compute.manager [req-644f915a-7c7e-4a08-aad9-fd88b8e46fe4 req-b06bbffd-91f1-4ff9-a3a0-c79133130094 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state active and task_state rescuing.
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG nova.virt.images [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] 3baaf3a6-e17d-454f-864d-c6abfa1b2b82 was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba.part /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba.part /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba.converted" returned: 0 in 0.161s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance running successfully.
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Failed to set time: agent not configured {{(pid=74482) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d80a8ad3-aaa9-4484-b3b6-db0edd0333b0 tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] finish_migration finished successfully. {{(pid=74482) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "f5b23a38bcf5d7a6375a0957139d966fe58252ba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.547s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "f5b23a38bcf5d7a6375a0957139d966fe58252ba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "f5b23a38bcf5d7a6375a0957139d966fe58252ba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba,backing_fmt=raw /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba,backing_fmt=raw /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue" returned: 0 in 0.053s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "f5b23a38bcf5d7a6375a0957139d966fe58252ba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'migration_context' on Instance uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<aa28db49-fd2f-4d64-96c3-4c14d805a37a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Start _get_guest_xml network_info=[{"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "vif_mac": "fa:16:3e:5a:7c:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3baaf3a6-e17d-454f-864d-c6abfa1b2b82', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPKYvIin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'aa28db49-fd2f-4d64-96c3-4c14d805a37a', 'attached_at': '', 'detached_at': '', 'volume_id': '78c9cff8-3189-4532-9d6d-bb7236e4d446', 'serial': '78c9cff8-3189-4532-9d6d-bb7236e4d446'}, 'disk_bus': 'virtio', 'attachment_id': '80e94649-c36a-402b-94d1-1ba7470b0c48', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'resources' on Instance uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<aa28db49-fd2f-4d64-96c3-4c14d805a37a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'numa_topology' on Instance uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<aa28db49-fd2f-4d64-96c3-4c14d805a37a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:05 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:05 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<aa28db49-fd2f-4d64-96c3-4c14d805a37a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPKYvIin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:04:05 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:04:05 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:04:05 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ad45b2-e7a3-4174-a906-3f7b7d3b6f1c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = FPKYvIin\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 23:04:05 user nova-compute[74482]: node.name = iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:04:05 user nova-compute[74482]: node.tpgt = -1
Oct 23 23:04:05 user nova-compute[74482]: node.startup = automatic
Oct 23 23:04:05 user nova-compute[74482]: node.leading_login = No
Oct 23 23:04:05 user nova-compute[74482]: iface.iscsi_ifacename = default
Oct 23 23:04:05 user nova-compute[74482]: iface.net_ifacename = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.ipaddress = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.prefix_len = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.hwaddress = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.transport_name = tcp
Oct 23 23:04:05 user nova-compute[74482]: iface.initiatorname = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.state = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.vlan_id = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.vlan_priority = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.vlan_state = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.iface_num = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.mtu = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.port = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.bootproto = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.subnet_mask = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.gateway = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.dhcp_alt_client_id = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.dhcp_dns = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.dhcp_learn_iqn = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.dhcp_vendor_id_state = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.dhcp_vendor_id = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.dhcp_slp_da = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.fragmentation = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.gratuitous_arp = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.incoming_forwarding = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.tos_state = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.tos = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.ttl = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.delayed_ack = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.tcp_nagle = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.tcp_wsf_state = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.tcp_wsf = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.tcp_timer_scale = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.tcp_timestamp = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.redirect = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.def_task_mgmt_timeout = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.header_digest = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.data_digest = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.immediate_data = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.initial_r2t = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.data_seq_inorder = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.data_pdu_inorder = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.erl = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.max_receive_data_len = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.first_burst_len = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.max_outstanding_r2t = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.max_burst_len = 0
Oct 23 23:04:05 user nova-compute[74482]: iface.chap_auth = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.bidi_chap = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.strict_login_compliance = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.discovery_auth = <empty>
Oct 23 23:04:05 user nova-compute[74482]: iface.discovery_logout = <empty>
Oct 23 23:04:05 user nova-compute[74482]: node.discovery_address = <empty>
Oct 23 23:04:05 user nova-compute[74482]: node.discovery_port = 0
Oct 23 23:04:05 user nova-compute[74482]: node.discovery_type = static
Oct 23 23:04:05 user nova-compute[74482]: node.session.initial_cmdsn = 0
Oct 23 23:04:05 user nova-compute[74482]: node.session.initial_login_retry_max = 8
Oct 23 23:04:05 user nova-compute[74482]: node.session.xmit_thread_priority = -20
Oct 23 23:04:05 user nova-compute[74482]: node.session.cmds_max = 128
Oct 23 23:04:05 user nova-compute[74482]: node.session.queue_depth = 32
Oct 23 23:04:05 user nova-compute[74482]: node.session.nr_sessions = 1
Oct 23 23:04:05 user nova-compute[74482]: node.session.auth.authmethod = CHAP
Oct 23 23:04:05 user nova-compute[74482]: node.session.auth.username = FPKYvIin
Oct 23 23:04:05 user nova-compute[74482]: node.session.auth.password = ***
Oct 23 23:04:05 user nova-compute[74482]: node.session.auth.username_in = <empty>
Oct 23 23:04:05 user nova-compute[74482]: node.session.auth.password_in = <empty>
Oct 23 23:04:05 user nova-compute[74482]: node.session.auth.chap_algs = MD5
Oct 23 23:04:05 user nova-compute[74482]: node.session.timeo.replacement_timeout = 120
Oct 23 23:04:05 user nova-compute[74482]: node.session.err_timeo.abort_timeout = 15
Oct 23 23:04:05 user nova-compute[74482]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 23:04:05 user nova-compute[74482]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 23:04:05 user nova-compute[74482]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.FastAbort = Yes
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.InitialR2T = No
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.ImmediateData = Yes
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.MaxConnections = 1
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 23:04:05 user nova-compute[74482]: node.session.iscsi.ERL = 0
Oct 23 23:04:05 user nova-compute[74482]: node.session.scan = manual
Oct 23 23:04:05 user nova-compute[74482]: node.session.reopen_max = 0
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].address = 172.16.0.220
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].port = 3260
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].startup = manual
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].tcp.window_size = 524288
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].tcp.type_of_service = 0
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].timeo.logout_timeout = 15
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].timeo.login_timeout = 15
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].timeo.auth_timeout = 45
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].iscsi.DataDigest = None
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].iscsi.IFMarker = No
Oct 23 23:04:05 user nova-compute[74482]: node.conn[0].iscsi.OFMarker = No
Oct 23 23:04:05 user nova-compute[74482]: # END RECORD
Oct 23 23:04:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[23947f32-fd8f-47e8-86eb-067e078c9b35]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[80570f64-392b-4234-9165-cf24d78b8597]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPKYvIin {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPKYvIin" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67ab48b-8ddd-44cd-8b9d-589bfa3ff7b0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FPKYvIin'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8af35-e3a3-4f38-b33a-8fd9be43812c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[920d9488-1fe9-4bcf-be01-15c6b664d474]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:04:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:04:05 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:04:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.201s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] HCTL ('34', '0', '0', 0) found on session 8 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6640aaf8-4f38-402d-8cc4-75718fb65602]: (4, ('0 0 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching for a device in session 8 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPKYvIin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.232s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] <== connect_volume: return (233ms) {'type': 'block', 'scsi_wwn': '26463356431613238', 'path': '/dev/sdc'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463356431613238', 'path': '/dev/sdc'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-943860777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-943860777',id=11,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:02:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-20n6qgib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:02:46Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=aa28db49-fd2f-4d64-96c3-4c14d805a37a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "vif_mac": "fa:16:3e:5a:7c:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "vif_mac": "fa:16:3e:5a:7c:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:7c:fa,bridge_name='br-int',has_traffic_filtering=True,id=9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca04dd6-98') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'pci_devices' on Instance uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.objects.base [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<aa28db49-fd2f-4d64-96c3-4c14d805a37a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:04:05 user nova-compute[74482]:   <uuid>aa28db49-fd2f-4d64-96c3-4c14d805a37a</uuid>
Oct 23 23:04:05 user nova-compute[74482]:   <name>instance-0000000b</name>
Oct 23 23:04:05 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:04:05 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:04:05 user nova-compute[74482]:   <metadata>
Oct 23 23:04:05 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:04:05 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:04:05 user nova-compute[74482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-943860777</nova:name>
Oct 23 23:04:05 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:04:05</nova:creationTime>
Oct 23 23:04:05 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:04:05 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:04:05 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:04:05 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:04:05 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:04:05 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:04:05 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:04:05 user nova-compute[74482]:       <nova:owner>
Oct 23 23:04:05 user nova-compute[74482]:         <nova:user uuid="ebd17d342e7145e0bad04188ec8be780">tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member</nova:user>
Oct 23 23:04:05 user nova-compute[74482]:         <nova:project uuid="981f084ec65e4fa0a9cbd2e5edf8302a">tempest-ServerBootFromVolumeStableRescueTest-157113739</nova:project>
Oct 23 23:04:05 user nova-compute[74482]:       </nova:owner>
Oct 23 23:04:05 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:04:05 user nova-compute[74482]:       <nova:ports>
Oct 23 23:04:05 user nova-compute[74482]:         <nova:port uuid="9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8">
Oct 23 23:04:05 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 23:04:05 user nova-compute[74482]:         </nova:port>
Oct 23 23:04:05 user nova-compute[74482]:       </nova:ports>
Oct 23 23:04:05 user nova-compute[74482]:     </nova:instance>
Oct 23 23:04:05 user nova-compute[74482]:   </metadata>
Oct 23 23:04:05 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:04:05 user nova-compute[74482]:     <system>
Oct 23 23:04:05 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:04:05 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:04:05 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:04:05 user nova-compute[74482]:       <entry name="serial">aa28db49-fd2f-4d64-96c3-4c14d805a37a</entry>
Oct 23 23:04:05 user nova-compute[74482]:       <entry name="uuid">aa28db49-fd2f-4d64-96c3-4c14d805a37a</entry>
Oct 23 23:04:05 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:04:05 user nova-compute[74482]:     </system>
Oct 23 23:04:05 user nova-compute[74482]:   </sysinfo>
Oct 23 23:04:05 user nova-compute[74482]:   <os>
Oct 23 23:04:05 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:04:05 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:04:05 user nova-compute[74482]:   </os>
Oct 23 23:04:05 user nova-compute[74482]:   <features>
Oct 23 23:04:05 user nova-compute[74482]:     <acpi/>
Oct 23 23:04:05 user nova-compute[74482]:     <apic/>
Oct 23 23:04:05 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:04:05 user nova-compute[74482]:   </features>
Oct 23 23:04:05 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:04:05 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:04:05 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:04:05 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:04:05 user nova-compute[74482]:   </clock>
Oct 23 23:04:05 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:04:05 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:04:05 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:04:05 user nova-compute[74482]:   </cpu>
Oct 23 23:04:05 user nova-compute[74482]:   <devices>
Oct 23 23:04:05 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:04:05 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:04:05 user nova-compute[74482]:       <source dev="/dev/sdc"/>
Oct 23 23:04:05 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:04:05 user nova-compute[74482]:       <serial>78c9cff8-3189-4532-9d6d-bb7236e4d446</serial>
Oct 23 23:04:05 user nova-compute[74482]:     </disk>
Oct 23 23:04:05 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:04:05 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:04:05 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue"/>
Oct 23 23:04:05 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:04:05 user nova-compute[74482]:       <boot order="1"/>
Oct 23 23:04:05 user nova-compute[74482]:     </disk>
Oct 23 23:04:05 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:04:05 user nova-compute[74482]:       <mac address="fa:16:3e:5a:7c:fa"/>
Oct 23 23:04:05 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:05 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:04:05 user nova-compute[74482]:       <target dev="tap9ca04dd6-98"/>
Oct 23 23:04:05 user nova-compute[74482]:     </interface>
Oct 23 23:04:05 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:04:05 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/console.log" append="off"/>
Oct 23 23:04:05 user nova-compute[74482]:     </serial>
Oct 23 23:04:05 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:04:05 user nova-compute[74482]:     <video>
Oct 23 23:04:05 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:05 user nova-compute[74482]:     </video>
Oct 23 23:04:05 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:04:05 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:04:05 user nova-compute[74482]:     </rng>
Oct 23 23:04:05 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:04:05 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:04:05 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:04:05 user nova-compute[74482]:     </memballoon>
Oct 23 23:04:05 user nova-compute[74482]:   </devices>
Oct 23 23:04:05 user nova-compute[74482]: </domain>
Oct 23 23:04:05 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:04:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Instance destroyed successfully.
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:04:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No VIF found with MAC fa:16:3e:5a:7c:fa, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a2b45979-d2a7-491f-9f1b-d2807462d3dc tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-1903c207-ad52-46d4-bbdf-5c5b5e99a1b6 req-a92c8500-e7ca-4fb0-8269-d30ae7c1dbea service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1903c207-ad52-46d4-bbdf-5c5b5e99a1b6 req-a92c8500-e7ca-4fb0-8269-d30ae7c1dbea service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1903c207-ad52-46d4-bbdf-5c5b5e99a1b6 req-a92c8500-e7ca-4fb0-8269-d30ae7c1dbea service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1903c207-ad52-46d4-bbdf-5c5b5e99a1b6 req-a92c8500-e7ca-4fb0-8269-d30ae7c1dbea service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-1903c207-ad52-46d4-bbdf-5c5b5e99a1b6 req-a92c8500-e7ca-4fb0-8269-d30ae7c1dbea service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:07 user nova-compute[74482]: WARNING nova.compute.manager [req-1903c207-ad52-46d4-bbdf-5c5b5e99a1b6 req-a92c8500-e7ca-4fb0-8269-d30ae7c1dbea service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state active and task_state rescuing.
Oct 23 23:04:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-9cc97ca3-ab54-465c-8c8b-821c35e4ef55 req-771305c4-1b98-4134-ac24-377deea0c646 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-unplugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9cc97ca3-ab54-465c-8c8b-821c35e4ef55 req-771305c4-1b98-4134-ac24-377deea0c646 service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9cc97ca3-ab54-465c-8c8b-821c35e4ef55 req-771305c4-1b98-4134-ac24-377deea0c646 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9cc97ca3-ab54-465c-8c8b-821c35e4ef55 req-771305c4-1b98-4134-ac24-377deea0c646 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-9cc97ca3-ab54-465c-8c8b-821c35e4ef55 req-771305c4-1b98-4134-ac24-377deea0c646 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-unplugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:08 user nova-compute[74482]: WARNING nova.compute.manager [req-9cc97ca3-ab54-465c-8c8b-821c35e4ef55 req-771305c4-1b98-4134-ac24-377deea0c646 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-unplugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state rescued and task_state None.
Oct 23 23:04:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-48afcdf1-e0b8-4c94-8cfb-dd5d15cdc40e req-62a2ff8c-ae49-4feb-b8a2-e56e2bff6163 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-48afcdf1-e0b8-4c94-8cfb-dd5d15cdc40e req-62a2ff8c-ae49-4feb-b8a2-e56e2bff6163 service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-48afcdf1-e0b8-4c94-8cfb-dd5d15cdc40e req-62a2ff8c-ae49-4feb-b8a2-e56e2bff6163 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-48afcdf1-e0b8-4c94-8cfb-dd5d15cdc40e req-62a2ff8c-ae49-4feb-b8a2-e56e2bff6163 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-48afcdf1-e0b8-4c94-8cfb-dd5d15cdc40e req-62a2ff8c-ae49-4feb-b8a2-e56e2bff6163 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:09 user nova-compute[74482]: WARNING nova.compute.manager [req-48afcdf1-e0b8-4c94-8cfb-dd5d15cdc40e req-62a2ff8c-ae49-4feb-b8a2-e56e2bff6163 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state active and task_state rescuing.
Oct 23 23:04:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c1d92c93-787d-4279-8015-bdbea15509c1 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:10 user nova-compute[74482]: WARNING nova.compute.manager [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state rescued and task_state None.
Oct 23 23:04:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:10 user nova-compute[74482]: WARNING nova.compute.manager [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state rescued and task_state None.
Oct 23 23:04:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:10 user nova-compute[74482]: WARNING nova.compute.manager [req-e80f6e0b-8fbb-44b9-bd41-53b3f3e21350 req-b9fac6e8-1c27-4bb8-9b1f-65d3d09a6269 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state rescued and task_state None.
Oct 23 23:04:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-06f810e0-72de-4930-82cc-91a7fc0fcc0e req-4fe4c2f1-c5c3-4fd7-8246-979e8fe5ff4b service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-changed-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-06f810e0-72de-4930-82cc-91a7fc0fcc0e req-4fe4c2f1-c5c3-4fd7-8246-979e8fe5ff4b service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing instance network info cache due to event network-changed-229b40af-c026-4f7a-a07d-f852450c0713. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:04:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-06f810e0-72de-4930-82cc-91a7fc0fcc0e req-4fe4c2f1-c5c3-4fd7-8246-979e8fe5ff4b service nova] Acquiring lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:04:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-06f810e0-72de-4930-82cc-91a7fc0fcc0e req-4fe4c2f1-c5c3-4fd7-8246-979e8fe5ff4b service nova] Acquired lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:04:12 user nova-compute[74482]: DEBUG nova.network.neutron [req-06f810e0-72de-4930-82cc-91a7fc0fcc0e req-4fe4c2f1-c5c3-4fd7-8246-979e8fe5ff4b service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Refreshing network info cache for port 229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:04:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:13 user nova-compute[74482]: DEBUG nova.network.neutron [req-06f810e0-72de-4930-82cc-91a7fc0fcc0e req-4fe4c2f1-c5c3-4fd7-8246-979e8fe5ff4b service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updated VIF entry in instance network info cache for port 229b40af-c026-4f7a-a07d-f852450c0713. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:04:13 user nova-compute[74482]: DEBUG nova.network.neutron [req-06f810e0-72de-4930-82cc-91a7fc0fcc0e req-4fe4c2f1-c5c3-4fd7-8246-979e8fe5ff4b service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-06f810e0-72de-4930-82cc-91a7fc0fcc0e req-4fe4c2f1-c5c3-4fd7-8246-979e8fe5ff4b service nova] Releasing lock "refresh_cache-4f8e4516-738d-4440-938e-88ede5fe7b31" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:04:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:04:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:04:14 user nova-compute[74482]: INFO nova.compute.claims [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Claim successful on node user
Oct 23 23:04:14 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:04:15 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.policy [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a0cc3a0ea394dcf85a7ede8e400faf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8b28ec62224967ab9679d4761e7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:04:15 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Creating image(s)
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:15 user nova-compute[74482]: INFO nova.compute.manager [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Terminating instance
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.381s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:04:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.231s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk 1073741824" returned: 0 in 0.113s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-5f6a175a-8670-444d-8b3a-704f6c181ac8 req-e1113ecf-4aa9-49fb-9b5b-3ba19c22fbf7 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5f6a175a-8670-444d-8b3a-704f6c181ac8 req-e1113ecf-4aa9-49fb-9b5b-3ba19c22fbf7 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5f6a175a-8670-444d-8b3a-704f6c181ac8 req-e1113ecf-4aa9-49fb-9b5b-3ba19c22fbf7 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5f6a175a-8670-444d-8b3a-704f6c181ac8 req-e1113ecf-4aa9-49fb-9b5b-3ba19c22fbf7 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-5f6a175a-8670-444d-8b3a-704f6c181ac8 req-e1113ecf-4aa9-49fb-9b5b-3ba19c22fbf7 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-unplugged-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-5f6a175a-8670-444d-8b3a-704f6c181ac8 req-e1113ecf-4aa9-49fb-9b5b-3ba19c22fbf7 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-229b40af-c026-4f7a-a07d-f852450c0713 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.358s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Successfully created port: d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Cannot resize image /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Ensure instance console log exists: /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-07bc8e5c-b3ad-46e0-bef0-298f5c2f29bf req-08de4e17-dc80-46db-b6a1-1d3db1b51469 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-07bc8e5c-b3ad-46e0-bef0-298f5c2f29bf req-08de4e17-dc80-46db-b6a1-1d3db1b51469 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-07bc8e5c-b3ad-46e0-bef0-298f5c2f29bf req-08de4e17-dc80-46db-b6a1-1d3db1b51469 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-07bc8e5c-b3ad-46e0-bef0-298f5c2f29bf req-08de4e17-dc80-46db-b6a1-1d3db1b51469 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-07bc8e5c-b3ad-46e0-bef0-298f5c2f29bf req-08de4e17-dc80-46db-b6a1-1d3db1b51469 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-unplugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-07bc8e5c-b3ad-46e0-bef0-298f5c2f29bf req-08de4e17-dc80-46db-b6a1-1d3db1b51469 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Updating instance_info_cache with network_info: [{"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Instance destroyed successfully.
Oct 23 23:04:17 user nova-compute[74482]: DEBUG nova.objects.instance [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lazy-loading 'resources' on Instance uuid 4f8e4516-738d-4440-938e-88ede5fe7b31 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:9e:c7,bridge_name='br-int',has_traffic_filtering=True,id=229b40af-c026-4f7a-a07d-f852450c0713,network=Network(56def97a-b5f4-4d08-9839-321a7f6669f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229b40af-c0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9e:c7,bridge_name='br-int',has_traffic_filtering=True,id=229b40af-c026-4f7a-a07d-f852450c0713,network=Network(56def97a-b5f4-4d08-9839-321a7f6669f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229b40af-c0') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap229b40af-c0, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afbade25-7dbc-4899-b245-842d1648497c) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: INFO os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:9e:c7,bridge_name='br-int',has_traffic_filtering=True,id=229b40af-c026-4f7a-a07d-f852450c0713,network=Network(56def97a-b5f4-4d08-9839-321a7f6669f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap229b40af-c0')
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:68,bridge_name='br-int',has_traffic_filtering=True,id=64a8d2d7-d71f-490b-b790-dfdca8b496c7,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap64a8d2d7-d7') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:68,bridge_name='br-int',has_traffic_filtering=True,id=64a8d2d7-d71f-490b-b790-dfdca8b496c7,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap64a8d2d7-d7') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64a8d2d7-d7, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f3f48d5-0d23-4877-80cd-817a77f26670) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: INFO os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:83:68,bridge_name='br-int',has_traffic_filtering=True,id=64a8d2d7-d71f-490b-b790-dfdca8b496c7,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap64a8d2d7-d7')
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e3efc9d-4f87-47c8-bdf6-f88cf14ba097,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3efc9d-4f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e3efc9d-4f87-47c8-bdf6-f88cf14ba097,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3efc9d-4f') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e3efc9d-4f, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b540587-5767-4dcc-8425-734d2afe7ea4) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Successfully updated port: d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: INFO os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e3efc9d-4f87-47c8-bdf6-f88cf14ba097,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1e3efc9d-4f')
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:1f:a6,bridge_name='br-int',has_traffic_filtering=True,id=2bd68230-dccb-4d57-ae57-a5799925a6fc,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd68230-dc') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:1f:a6,bridge_name='br-int',has_traffic_filtering=True,id=2bd68230-dccb-4d57-ae57-a5799925a6fc,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd68230-dc') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bd68230-dc, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquired lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6413783-0253-475b-9a0e-9a20e4426b2d) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: INFO os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:1f:a6,bridge_name='br-int',has_traffic_filtering=True,id=2bd68230-dccb-4d57-ae57-a5799925a6fc,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd68230-dc')
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:97:57,bridge_name='br-int',has_traffic_filtering=True,id=790f6250-f4da-4645-b46e-abd17525e803,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790f6250-f4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:97:57,bridge_name='br-int',has_traffic_filtering=True,id=790f6250-f4da-4645-b46e-abd17525e803,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790f6250-f4') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap790f6250-f4, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:18 user nova-compute[74482]: WARNING nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-229b40af-c026-4f7a-a07d-f852450c0713 for instance with vm_state active and task_state deleting.
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-unplugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:18 user nova-compute[74482]: WARNING nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-64a8d2d7-d71f-490b-b790-dfdca8b496c7 for instance with vm_state active and task_state deleting.
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-unplugged-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-2bd68230-dccb-4d57-ae57-a5799925a6fc for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-changed-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Refreshing instance network info cache due to event network-changed-d1739e04-cfa4-4e83-bc72-4f508cbfd0df. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Acquiring lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54e00db5-2f6c-4342-9cd5-f5c87c9e4924) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: INFO os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:97:57,bridge_name='br-int',has_traffic_filtering=True,id=790f6250-f4da-4645-b46e-abd17525e803,network=Network(387df2ed-7182-4954-bbd5-d03a94e2215c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790f6250-f4')
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "9a33e15e-c112-43ba-92be-faed55a7c76c", "address": "fa:16:3e:c7:b1:59", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a33e15e-c1", "ovs_interfaceid": "9a33e15e-c112-43ba-92be-faed55a7c76c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b1:59,bridge_name='br-int',has_traffic_filtering=True,id=9a33e15e-c112-43ba-92be-faed55a7c76c,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a33e15e-c1') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b1:59,bridge_name='br-int',has_traffic_filtering=True,id=9a33e15e-c112-43ba-92be-faed55a7c76c,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a33e15e-c1') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a33e15e-c1, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76e71d45-9c3e-4d93-a883-a0115c87a207) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: INFO os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:b1:59,bridge_name='br-int',has_traffic_filtering=True,id=9a33e15e-c112-43ba-92be-faed55a7c76c,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a33e15e-c1')
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1293835838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1293835838',id=10,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeNDc+QcJ3JYM2K/BQru1crmBIYzTfyjwiK1hhlXq9Qu63Y86C/xhvA215u99eYnfsfSzNc2FRmGSsYVZUq838Fb7Wr1Orhl5hCEREPBNqA4M13oTfER4MQ6cl2XeZbwg==',key_name='tempest-keypair-511563375',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:02:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12a4631cefff4ab3a81dcaeab669a0f6',ramdisk_id='',reservation_id='r-8jf98guv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1551547892',owner_user_name='tempest-TaggedBootDevicesTest_v242-1551547892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19312461863840a3958147887f6ed1e8',uuid=4f8e4516-738d-4440-938e-88ede5fe7b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converting VIF {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:df:c7,bridge_name='br-int',has_traffic_filtering=True,id=94afaf97-3346-4e42-9201-65840d08a317,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94afaf97-33') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:df:c7,bridge_name='br-int',has_traffic_filtering=True,id=94afaf97-3346-4e42-9201-65840d08a317,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94afaf97-33') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94afaf97-33, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c66d976-782e-40c0-a51d-eac13189a962) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:18 user nova-compute[74482]: INFO os_vif [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:df:c7,bridge_name='br-int',has_traffic_filtering=True,id=94afaf97-3346-4e42-9201-65840d08a317,network=Network(2768cc52-9613-43cf-998c-7e988c528929),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94afaf97-33')
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gpsuDdNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:04:18 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[56556216-ae61-4c54-9ced-38870f41d4f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:04:18 user nova-compute[74482]: No targets found.
Oct 23 23:04:18 user nova-compute[74482]: iSNS:
Oct 23 23:04:18 user nova-compute[74482]: No targets found.
Oct 23 23:04:18 user nova-compute[74482]: STATIC:
Oct 23 23:04:18 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455
Oct 23 23:04:18 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:18 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:18 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7
Oct 23 23:04:18 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:18 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:18 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe
Oct 23 23:04:18 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:18 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:18 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:04:18 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:18 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:18 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:04:18 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:18 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:18 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:04:18 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:18 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:18 user nova-compute[74482]: FIRMWARE:
Oct 23 23:04:18 user nova-compute[74482]: No targets found.
Oct 23 23:04:18 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:04:18 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:04:18 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef2a303-7ed0-4ff3-8b47-3527179a585a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:18 user nova-compute[74482]: WARNING nova.compute.manager [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-1e3efc9d-4f87-47c8-bdf6-f88cf14ba097 for instance with vm_state active and task_state deleting.
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-unplugged-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-94afaf97-3346-4e42-9201-65840d08a317 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:18 user nova-compute[74482]: WARNING nova.compute.manager [req-fd3d2562-4ed7-4e1b-b200-95436be7321f req-0c6810d5-6555-48fc-beff-fb38dfbf788c service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-94afaf97-3346-4e42-9201-65840d08a317 for instance with vm_state active and task_state deleting.
Oct 23 23:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c19c529-25af-4f47-8f66-2f049d3e694c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c634790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455'): ({'sde'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Removing single pathed devices sde {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8a816d-5306-45f4-9736-0c972538bf08]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8fa3ba-fb1b-436a-a293-194cb269df3d]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Flushing IO for device /dev/sde {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating instance_info_cache with network_info: [{"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c41123-0c71-499b-9121-a6a3e520eb34]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Releasing lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Instance network_info: |[{"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Acquired lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.network.neutron [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Refreshing network info cache for port d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Start _get_guest_xml network_info=[{"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed68986-c66c-4cbd-8cfb-9c794c3762a8]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1736457799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1736457799',id=14,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qsXrQessntnV1ggy4TtGhnjE2kFMAm3s1+DIHjlcVYXHL0gF6xHKL7xIdhkF0DlXvm8j+JS6shzfqKN69YtxRTbxo+XLeEdMDeMHhyLn/eHYes9kQEt1YgJ6oZynFVA==',key_name='tempest-keypair-1108949033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8b28ec62224967ab9679d4761e7e67',ramdisk_id='',reservation_id='r-evruxiqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2107078344',owner_user_name='tempest-TaggedAttachmentsTest-2107078344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0cc3a0ea394dcf85a7ede8e400faf5',uuid=777f18b7-f03c-449f-ad4b-50ebeb67a38b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converting VIF {"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d5:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1739e04-cfa4-4e83-bc72-4f508cbfd0df,network=Network(f94545b6-b13f-4b55-b05b-3dbca149f956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1739e04-cf') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lazy-loading 'pci_devices' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dea25b8-3513-480a-adb8-0087e0bd27ba]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:04:19 user nova-compute[74482]:   <uuid>777f18b7-f03c-449f-ad4b-50ebeb67a38b</uuid>
Oct 23 23:04:19 user nova-compute[74482]:   <name>instance-0000000e</name>
Oct 23 23:04:19 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:04:19 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:04:19 user nova-compute[74482]:   <metadata>
Oct 23 23:04:19 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:04:19 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:04:19 user nova-compute[74482]:       <nova:name>tempest-device-tagging-server-1736457799</nova:name>
Oct 23 23:04:19 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:04:19</nova:creationTime>
Oct 23 23:04:19 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:04:19 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:04:19 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:04:19 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:04:19 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:04:19 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:04:19 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:04:19 user nova-compute[74482]:       <nova:owner>
Oct 23 23:04:19 user nova-compute[74482]:         <nova:user uuid="3a0cc3a0ea394dcf85a7ede8e400faf5">tempest-TaggedAttachmentsTest-2107078344-project-member</nova:user>
Oct 23 23:04:19 user nova-compute[74482]:         <nova:project uuid="2d8b28ec62224967ab9679d4761e7e67">tempest-TaggedAttachmentsTest-2107078344</nova:project>
Oct 23 23:04:19 user nova-compute[74482]:       </nova:owner>
Oct 23 23:04:19 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:04:19 user nova-compute[74482]:       <nova:ports>
Oct 23 23:04:19 user nova-compute[74482]:         <nova:port uuid="d1739e04-cfa4-4e83-bc72-4f508cbfd0df">
Oct 23 23:04:19 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 23:04:19 user nova-compute[74482]:         </nova:port>
Oct 23 23:04:19 user nova-compute[74482]:       </nova:ports>
Oct 23 23:04:19 user nova-compute[74482]:     </nova:instance>
Oct 23 23:04:19 user nova-compute[74482]:   </metadata>
Oct 23 23:04:19 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:04:19 user nova-compute[74482]:     <system>
Oct 23 23:04:19 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:04:19 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:04:19 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:04:19 user nova-compute[74482]:       <entry name="serial">777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:04:19 user nova-compute[74482]:       <entry name="uuid">777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:04:19 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:04:19 user nova-compute[74482]:     </system>
Oct 23 23:04:19 user nova-compute[74482]:   </sysinfo>
Oct 23 23:04:19 user nova-compute[74482]:   <os>
Oct 23 23:04:19 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:04:19 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:04:19 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:04:19 user nova-compute[74482]:   </os>
Oct 23 23:04:19 user nova-compute[74482]:   <features>
Oct 23 23:04:19 user nova-compute[74482]:     <acpi/>
Oct 23 23:04:19 user nova-compute[74482]:     <apic/>
Oct 23 23:04:19 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:04:19 user nova-compute[74482]:   </features>
Oct 23 23:04:19 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:04:19 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:04:19 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:04:19 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:04:19 user nova-compute[74482]:   </clock>
Oct 23 23:04:19 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:04:19 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:04:19 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:04:19 user nova-compute[74482]:   </cpu>
Oct 23 23:04:19 user nova-compute[74482]:   <devices>
Oct 23 23:04:19 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:04:19 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:04:19 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk"/>
Oct 23 23:04:19 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:04:19 user nova-compute[74482]:     </disk>
Oct 23 23:04:19 user nova-compute[74482]:     <disk type="file" device="cdrom">
Oct 23 23:04:19 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 23:04:19 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.config"/>
Oct 23 23:04:19 user nova-compute[74482]:       <target dev="hda" bus="ide"/>
Oct 23 23:04:19 user nova-compute[74482]:     </disk>
Oct 23 23:04:19 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:04:19 user nova-compute[74482]:       <mac address="fa:16:3e:f4:d5:ac"/>
Oct 23 23:04:19 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:19 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:04:19 user nova-compute[74482]:       <target dev="tapd1739e04-cf"/>
Oct 23 23:04:19 user nova-compute[74482]:     </interface>
Oct 23 23:04:19 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:04:19 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log" append="off"/>
Oct 23 23:04:19 user nova-compute[74482]:     </serial>
Oct 23 23:04:19 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:04:19 user nova-compute[74482]:     <video>
Oct 23 23:04:19 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:19 user nova-compute[74482]:     </video>
Oct 23 23:04:19 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:04:19 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:04:19 user nova-compute[74482]:     </rng>
Oct 23 23:04:19 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:04:19 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:04:19 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:04:19 user nova-compute[74482]:     </memballoon>
Oct 23 23:04:19 user nova-compute[74482]:   </devices>
Oct 23 23:04:19 user nova-compute[74482]: </domain>
Oct 23 23:04:19 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1736457799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1736457799',id=14,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qsXrQessntnV1ggy4TtGhnjE2kFMAm3s1+DIHjlcVYXHL0gF6xHKL7xIdhkF0DlXvm8j+JS6shzfqKN69YtxRTbxo+XLeEdMDeMHhyLn/eHYes9kQEt1YgJ6oZynFVA==',key_name='tempest-keypair-1108949033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8b28ec62224967ab9679d4761e7e67',ramdisk_id='',reservation_id='r-evruxiqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2107078344',owner_user_name='tempest-TaggedAttachmentsTest-2107078344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0cc3a0ea394dcf85a7ede8e400faf5',uuid=777f18b7-f03c-449f-ad4b-50ebeb67a38b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converting VIF {"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d5:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1739e04-cfa4-4e83-bc72-4f508cbfd0df,network=Network(f94545b6-b13f-4b55-b05b-3dbca149f956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1739e04-cf') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_vif [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d5:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1739e04-cfa4-4e83-bc72-4f508cbfd0df,network=Network(f94545b6-b13f-4b55-b05b-3dbca149f956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1739e04-cf') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '933502c9-9b77-581b-aa39-e5c974635e6d', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1739e04-cf, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1739e04-cf, col_values=(('qos', UUID('a7173116-b4cb-45d3-8bdd-80ebc82c8158')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1739e04-cf, col_values=(('external_ids', {'iface-id': 'd1739e04-cfa4-4e83-bc72-4f508cbfd0df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:d5:ac', 'vm-uuid': '777f18b7-f03c-449f-ad4b-50ebeb67a38b'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:19 user nova-compute[74482]: INFO os_vif [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:d5:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1739e04-cfa4-4e83-bc72-4f508cbfd0df,network=Network(f94545b6-b13f-4b55-b05b-3dbca149f956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1739e04-cf')
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --logout" returned: 0 in 0.119s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7847aec5-a8e1-410e-a462-d96fba4fe26c]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455, portal: 172.16.0.220,3260]
Oct 23 23:04:19 user nova-compute[74482]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455, portal: 172.16.0.220,3260] successful.
Oct 23 23:04:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.306s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1860888-6ec1-4ae7-8efc-a19ae27eb455 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c46c31-2f1d-4456-8ca4-d55ba2fce889]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.709s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] <== disconnect_volume: return (713ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mnfGpWVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:04:19 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] No BDM found with device name hda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] No VIF found with MAC fa:16:3e:f4:d5:ac, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:04:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Using config drive
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[230722ee-5599-40d7-a996-2818087e1195]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:04:19 user nova-compute[74482]: No targets found.
Oct 23 23:04:19 user nova-compute[74482]: iSNS:
Oct 23 23:04:19 user nova-compute[74482]: No targets found.
Oct 23 23:04:19 user nova-compute[74482]: STATIC:
Oct 23 23:04:19 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7
Oct 23 23:04:19 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:19 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:19 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe
Oct 23 23:04:19 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:19 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:19 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:04:19 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:19 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:19 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:04:19 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:19 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:19 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:04:19 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:19 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:19 user nova-compute[74482]: FIRMWARE:
Oct 23 23:04:19 user nova-compute[74482]: No targets found.
Oct 23 23:04:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:04:19 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:04:19 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a32b6-00c8-4009-9efb-a2bd8fa13f0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8517e1-0c8b-47cf-9303-977659eacb32]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:04:19 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:04:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3084355750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7'): ({'sdf'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Removing single pathed devices sdf {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4a4f68-d2eb-4200-9dd3-7730cfeac73c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e01335-fb7e-4270-8f0d-d16a74ddef04]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Flushing IO for device /dev/sdf {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Creating config drive at /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.config
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph_pk91y2 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a31973-5d6b-4bfe-9707-c6ba00bcb58b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph_pk91y2" returned: 0 in 0.062s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.068s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72bde6d-b404-4881-b7e2-9c7b232aa917]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.network.neutron [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updated VIF entry in instance network info cache for port d1739e04-cfa4-4e83-bc72-4f508cbfd0df. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.network.neutron [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating instance_info_cache with network_info: [{"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Releasing lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:19 user nova-compute[74482]: WARNING nova.compute.manager [req-0d95832e-0ff6-4da3-b64e-45f52204d0cc req-51b7de99-ccab-4de4-b9e3-301fdbb926e5 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-2bd68230-dccb-4d57-ae57-a5799925a6fc for instance with vm_state active and task_state deleting.
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[997a5b4b-8c48-4c18-a68d-25ecf3f3acdc]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c6be3e-46e3-479c-a4a9-a761157f0094]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7, portal: 172.16.0.220,3260]
Oct 23 23:04:20 user nova-compute[74482]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7, portal: 172.16.0.220,3260] successful.
Oct 23 23:04:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d66b2221-0469-4917-a502-20c0d3c8f1a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c76008-b439-4e35-b3ed-2a6e5fe5b231]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.604s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] <== disconnect_volume: return (606ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pOcdobMj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:04:20 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e217019f-5aad-496a-8ecb-63ddc58e8250]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:04:20 user nova-compute[74482]: No targets found.
Oct 23 23:04:20 user nova-compute[74482]: iSNS:
Oct 23 23:04:20 user nova-compute[74482]: No targets found.
Oct 23 23:04:20 user nova-compute[74482]: STATIC:
Oct 23 23:04:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe
Oct 23 23:04:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:04:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:04:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:04:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:04:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:04:20 user nova-compute[74482]: FIRMWARE:
Oct 23 23:04:20 user nova-compute[74482]: No targets found.
Oct 23 23:04:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:04:20 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:04:20 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b68d4d-2a4c-4f5c-9db1-1e54eaec9a14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[467b27a5-fce8-4950-aedd-4c87622dccdd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:04:20 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:04:20 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:04:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:04:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:04:20 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:04:20 user nova-compute[74482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe (non-flash)
Oct 23 23:04:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:04:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c4935b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc4ea35-93d3-436a-b49c-1ce77b536986]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e41761-8703-447f-a32d-8cfeec981dee]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[54686918-5dc6-44d5-a85c-70d63db090c3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[86153ff0-67c1-4460-a8d5-9f8e0d48c17f]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d09c3f5-fbf0-4b4e-a8df-2f2dc7ec1a8e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65b32e8-a70c-476e-a276-64ab7bffe302]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe, portal: 172.16.0.220,3260]
Oct 23 23:04:20 user nova-compute[74482]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe, portal: 172.16.0.220,3260] successful.
Oct 23 23:04:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1365030-012b-4dde-9785-9b399480f9fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b499d9a-fd6b-49b6-b45e-9ecbe97da250]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] <== disconnect_volume: return (406ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:04:20 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Deleting instance files /opt/stack/data/nova/instances/4f8e4516-738d-4440-938e-88ede5fe7b31_del
Oct 23 23:04:20 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Deletion of /opt/stack/data/nova/instances/4f8e4516-738d-4440-938e-88ede5fe7b31_del complete
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-unplugged-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-790f6250-f4da-4645-b46e-abd17525e803 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:20 user nova-compute[74482]: WARNING nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-790f6250-f4da-4645-b46e-abd17525e803 for instance with vm_state active and task_state deleting.
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-unplugged-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-unplugged-9a33e15e-c112-43ba-92be-faed55a7c76c for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-plugged-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Acquiring lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] No waiting events found dispatching network-vif-plugged-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:20 user nova-compute[74482]: WARNING nova.compute.manager [req-8186f51b-3dda-4a24-b3f2-0c479ec9728c req-b1514697-c6b6-4ca4-8f81-54ac849e8519 service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received unexpected event network-vif-plugged-9a33e15e-c112-43ba-92be-faed55a7c76c for instance with vm_state active and task_state deleting.
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:20 user nova-compute[74482]: INFO nova.compute.manager [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Took 4.94 seconds to destroy the instance on the hypervisor.
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:22 user nova-compute[74482]: INFO nova.compute.manager [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Terminating instance
Oct 23 23:04:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-plugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] No waiting events found dispatching network-vif-plugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:22 user nova-compute[74482]: WARNING nova.compute.manager [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received unexpected event network-vif-plugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df for instance with vm_state building and task_state spawning.
Oct 23 23:04:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-plugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] No waiting events found dispatching network-vif-plugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:22 user nova-compute[74482]: WARNING nova.compute.manager [req-71e4b1db-c90d-47fa-8b9b-cd2e16364f7b req-25a67bfb-d309-4a57-a4f3-ed700df64048 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received unexpected event network-vif-plugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df for instance with vm_state building and task_state spawning.
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:04:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-b6211413-5221-4d64-9c7d-59de43b255a6 req-cac67cc1-76e1-4b21-9fb7-313f8c497c86 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received event network-vif-unplugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b6211413-5221-4d64-9c7d-59de43b255a6 req-cac67cc1-76e1-4b21-9fb7-313f8c497c86 service nova] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b6211413-5221-4d64-9c7d-59de43b255a6 req-cac67cc1-76e1-4b21-9fb7-313f8c497c86 service nova] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b6211413-5221-4d64-9c7d-59de43b255a6 req-cac67cc1-76e1-4b21-9fb7-313f8c497c86 service nova] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-b6211413-5221-4d64-9c7d-59de43b255a6 req-cac67cc1-76e1-4b21-9fb7-313f8c497c86 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] No waiting events found dispatching network-vif-unplugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-b6211413-5221-4d64-9c7d-59de43b255a6 req-cac67cc1-76e1-4b21-9fb7-313f8c497c86 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received event network-vif-unplugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:04:23 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Instance destroyed successfully.
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.objects.instance [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lazy-loading 'resources' on Instance uuid e8bdfd0e-24d2-4f31-a650-60edac47fc97 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1472035309',display_name='tempest-TestVolumeSwap-server-1472035309',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1472035309',id=8,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxJL7TJEE8TYIXXzw4QMbhMkB3aPqm3OJbcAY6YvI/eDYL+DKlVxIU8Ze8ndQZcYoVP9iQP1nhl6IyRnOXE74r9WHwvOsCf7WLJLhhY4Tvn3mT8bUR6V1ftvl8vC8iODA==',key_name='tempest-keypair-1789462894',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6de9c2d01774a2bbcad554f40ce9d8a',ramdisk_id='',reservation_id='r-x650kg5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-145807861',owner_user_name='tempest-TestVolumeSwap-145807861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92548c712df94fcfbce368fd943d0b6f',uuid=e8bdfd0e-24d2-4f31-a650-60edac47fc97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Converting VIF {"id": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "address": "fa:16:3e:e4:23:61", "network": {"id": "643e2873-2623-45e5-8322-3b68049f2295", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1510051911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6de9c2d01774a2bbcad554f40ce9d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bf792d-71", "ovs_interfaceid": "01bf792d-71d9-4ebb-822a-b3ed3b696af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:23:61,bridge_name='br-int',has_traffic_filtering=True,id=01bf792d-71d9-4ebb-822a-b3ed3b696af2,network=Network(643e2873-2623-45e5-8322-3b68049f2295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf792d-71') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG os_vif [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:23:61,bridge_name='br-int',has_traffic_filtering=True,id=01bf792d-71d9-4ebb-822a-b3ed3b696af2,network=Network(643e2873-2623-45e5-8322-3b68049f2295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf792d-71') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01bf792d-71, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4127abd-c111-4869-91e5-4604dd15bd6a) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '4f8e4516-738d-4440-938e-88ede5fe7b31' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '4f8e4516-738d-4440-938e-88ede5fe7b31' (instance-0000000a)
Oct 23 23:04:23 user nova-compute[74482]: INFO os_vif [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:23:61,bridge_name='br-int',has_traffic_filtering=True,id=01bf792d-71d9-4ebb-822a-b3ed3b696af2,network=Network(643e2873-2623-45e5-8322-3b68049f2295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bf792d-71')
Oct 23 23:04:23 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Deleting instance files /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97_del
Oct 23 23:04:23 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Deletion of /opt/stack/data/nova/instances/e8bdfd0e-24d2-4f31-a650-60edac47fc97_del complete
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:23 user nova-compute[74482]: INFO nova.compute.manager [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:23 user nova-compute[74482]: INFO nova.compute.manager [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Terminating instance
Oct 23 23:04:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue --force-share --output=json" returned: 0 in 0.286s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:04:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Instance spawned successfully.
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:24 user nova-compute[74482]: INFO nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Took 9.01 seconds to spawn the instance on the hypervisor.
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-f3f85767-9fab-432a-b6ad-360942ebd9ba req-ad8f9861-e586-4700-9db4-8f226d94ceb7 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received event network-vif-unplugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f3f85767-9fab-432a-b6ad-360942ebd9ba req-ad8f9861-e586-4700-9db4-8f226d94ceb7 service nova] Acquiring lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f3f85767-9fab-432a-b6ad-360942ebd9ba req-ad8f9861-e586-4700-9db4-8f226d94ceb7 service nova] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f3f85767-9fab-432a-b6ad-360942ebd9ba req-ad8f9861-e586-4700-9db4-8f226d94ceb7 service nova] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-f3f85767-9fab-432a-b6ad-360942ebd9ba req-ad8f9861-e586-4700-9db4-8f226d94ceb7 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] No waiting events found dispatching network-vif-unplugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-f3f85767-9fab-432a-b6ad-360942ebd9ba req-ad8f9861-e586-4700-9db4-8f226d94ceb7 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received event network-vif-unplugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:04:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Instance destroyed successfully.
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.objects.instance [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lazy-loading 'resources' on Instance uuid 31c01877-ca5c-45cd-b85a-ec624b3e2a3f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-697166623',display_name='tempest-VolumesActionsTest-instance-697166623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-697166623',id=12,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:02:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a325a57cab5d4baea61d50a50d520b1c',ramdisk_id='',reservation_id='r-i0qjkglj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-732614350',owner_user_name='tempest-VolumesActionsTest-732614350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:02:40Z,user_data=None,user_id='875daa8820804264a89ecfc2c6884fa1',uuid=31c01877-ca5c-45cd-b85a-ec624b3e2a3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converting VIF {"id": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "address": "fa:16:3e:64:4f:87", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c150b3-18", "ovs_interfaceid": "09c150b3-181b-47ed-b0b0-964e8d60f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=09c150b3-181b-47ed-b0b0-964e8d60f2e0,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c150b3-18') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG os_vif [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=09c150b3-181b-47ed-b0b0-964e8d60f2e0,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c150b3-18') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09c150b3-18, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04b7e536-b5ff-4cd9-aba0-1808953c8133) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:24 user nova-compute[74482]: INFO os_vif [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=09c150b3-181b-47ed-b0b0-964e8d60f2e0,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c150b3-18')
Oct 23 23:04:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Deleting instance files /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f_del
Oct 23 23:04:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Deletion of /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f_del complete
Oct 23 23:04:24 user nova-compute[74482]: INFO nova.compute.manager [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 23 23:04:24 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk --force-share --output=json" returned: 1 in 0.255s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk --force-share --output=json' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:04:24 user nova-compute[74482]: INFO nova.compute.manager [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Took 10.24 seconds to build instance.
Oct 23 23:04:24 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000c, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/31c01877-ca5c-45cd-b85a-ec624b3e2a3f/disk
Oct 23 23:04:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d9bb3fcc-0d17-4c4c-9937-ee0f17430319 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.451s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-deleted-9a33e15e-c112-43ba-92be-faed55a7c76c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:25 user nova-compute[74482]: INFO nova.compute.manager [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Neutron deleted interface 9a33e15e-c112-43ba-92be-faed55a7c76c; detaching it from the instance and deleting it from the info cache
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.network.neutron [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "790f6250-f4da-4645-b46e-abd17525e803", "address": "fa:16:3e:b5:97:57", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790f6250-f4", "ovs_interfaceid": "790f6250-f4da-4645-b46e-abd17525e803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-a2630eeb-6ad0-402d-ae2a-b55a502f729b req-7bb4d48f-bddb-40f7-a9b3-a23da0bff0f2 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received event network-vif-plugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a2630eeb-6ad0-402d-ae2a-b55a502f729b req-7bb4d48f-bddb-40f7-a9b3-a23da0bff0f2 service nova] Acquiring lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a2630eeb-6ad0-402d-ae2a-b55a502f729b req-7bb4d48f-bddb-40f7-a9b3-a23da0bff0f2 service nova] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a2630eeb-6ad0-402d-ae2a-b55a502f729b req-7bb4d48f-bddb-40f7-a9b3-a23da0bff0f2 service nova] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-a2630eeb-6ad0-402d-ae2a-b55a502f729b req-7bb4d48f-bddb-40f7-a9b3-a23da0bff0f2 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] No waiting events found dispatching network-vif-plugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:25 user nova-compute[74482]: WARNING nova.compute.manager [req-a2630eeb-6ad0-402d-ae2a-b55a502f729b req-7bb4d48f-bddb-40f7-a9b3-a23da0bff0f2 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received unexpected event network-vif-plugged-01bf792d-71d9-4ebb-822a-b3ed3b696af2 for instance with vm_state active and task_state deleting.
Oct 23 23:04:25 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:25 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7336MB free_disk=25.073436737060547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Detach interface failed, port_id=9a33e15e-c112-43ba-92be-faed55a7c76c, reason: Instance 4f8e4516-738d-4440-938e-88ede5fe7b31 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-deleted-790f6250-f4da-4645-b46e-abd17525e803 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:25 user nova-compute[74482]: INFO nova.compute.manager [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Neutron deleted interface 790f6250-f4da-4645-b46e-abd17525e803; detaching it from the instance and deleting it from the info cache
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.network.neutron [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94afaf97-3346-4e42-9201-65840d08a317", "address": "fa:16:3e:d3:df:c7", "network": {"id": "2768cc52-9613-43cf-998c-7e988c528929", "bridge": "br-int", "label": "tempest-device-tagging-net2-581991720", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94afaf97-33", "ovs_interfaceid": "94afaf97-3346-4e42-9201-65840d08a317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:25 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Took 1.89 seconds to deallocate network for instance.
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Detach interface failed, port_id=790f6250-f4da-4645-b46e-abd17525e803, reason: Instance 4f8e4516-738d-4440-938e-88ede5fe7b31 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-deleted-94afaf97-3346-4e42-9201-65840d08a317 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:25 user nova-compute[74482]: INFO nova.compute.manager [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Neutron deleted interface 94afaf97-3346-4e42-9201-65840d08a317; detaching it from the instance and deleting it from the info cache
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.network.neutron [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "address": "fa:16:3e:98:1f:a6", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd68230-dc", "ovs_interfaceid": "2bd68230-dccb-4d57-ae57-a5799925a6fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-f4fffbd6-b355-4ab6-a56b-7b886d94464b req-7c6e3395-2d1d-476d-af89-a67e8a59657f service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Detach interface failed, port_id=94afaf97-3346-4e42-9201-65840d08a317, reason: Instance 4f8e4516-738d-4440-938e-88ede5fe7b31 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Applying migration context for instance aa063829-b117-40f4-93f2-358b33f1d156 as it has an incoming, in-progress migration 1038afda-29ba-4303-9327-eb047061724b. Migration status is finished {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 23:04:25 user nova-compute[74482]: INFO nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating resource usage from migration 1038afda-29ba-4303-9327-eb047061724b
Oct 23 23:04:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e8bdfd0e-24d2-4f31-a650-60edac47fc97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4f8e4516-738d-4440-938e-88ede5fe7b31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 31c01877-ca5c-45cd-b85a-ec624b3e2a3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Migration 1038afda-29ba-4303-9327-eb047061724b is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa063829-b117-40f4-93f2-358b33f1d156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:25 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Took 1.21 seconds to deallocate network for instance.
Oct 23 23:04:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:04:25 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.511s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-eb16a7e6-413b-49f3-b3e7-5efeb0f5e9d0 req-cde47615-3ac1-4aeb-978c-31be3a31c328 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received event network-vif-plugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eb16a7e6-413b-49f3-b3e7-5efeb0f5e9d0 req-cde47615-3ac1-4aeb-978c-31be3a31c328 service nova] Acquiring lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eb16a7e6-413b-49f3-b3e7-5efeb0f5e9d0 req-cde47615-3ac1-4aeb-978c-31be3a31c328 service nova] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eb16a7e6-413b-49f3-b3e7-5efeb0f5e9d0 req-cde47615-3ac1-4aeb-978c-31be3a31c328 service nova] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-eb16a7e6-413b-49f3-b3e7-5efeb0f5e9d0 req-cde47615-3ac1-4aeb-978c-31be3a31c328 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] No waiting events found dispatching network-vif-plugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:26 user nova-compute[74482]: WARNING nova.compute.manager [req-eb16a7e6-413b-49f3-b3e7-5efeb0f5e9d0 req-cde47615-3ac1-4aeb-978c-31be3a31c328 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received unexpected event network-vif-plugged-09c150b3-181b-47ed-b0b0-964e8d60f2e0 for instance with vm_state deleted and task_state None.
Oct 23 23:04:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-eb16a7e6-413b-49f3-b3e7-5efeb0f5e9d0 req-cde47615-3ac1-4aeb-978c-31be3a31c328 service nova] [instance: e8bdfd0e-24d2-4f31-a650-60edac47fc97] Received event network-vif-deleted-01bf792d-71d9-4ebb-822a-b3ed3b696af2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.553s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.690s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:26 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Deleted allocations for instance e8bdfd0e-24d2-4f31-a650-60edac47fc97
Oct 23 23:04:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b95f99a7-a441-4e71-841f-311717b7bfb1 tempest-TestVolumeSwap-145807861 tempest-TestVolumeSwap-145807861-project-member] Lock "e8bdfd0e-24d2-4f31-a650-60edac47fc97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.317s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-f3ccb173-8c48-4638-bf86-5bd301778290 req-ed2f343f-9f01-47a9-b080-004c40b0f9df service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-deleted-2bd68230-dccb-4d57-ae57-a5799925a6fc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:26 user nova-compute[74482]: INFO nova.compute.manager [req-f3ccb173-8c48-4638-bf86-5bd301778290 req-ed2f343f-9f01-47a9-b080-004c40b0f9df service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Neutron deleted interface 2bd68230-dccb-4d57-ae57-a5799925a6fc; detaching it from the instance and deleting it from the info cache
Oct 23 23:04:26 user nova-compute[74482]: DEBUG nova.network.neutron [req-f3ccb173-8c48-4638-bf86-5bd301778290 req-ed2f343f-9f01-47a9-b080-004c40b0f9df service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [{"id": "229b40af-c026-4f7a-a07d-f852450c0713", "address": "fa:16:3e:23:9e:c7", "network": {"id": "56def97a-b5f4-4d08-9839-321a7f6669f0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1807774813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap229b40af-c0", "ovs_interfaceid": "229b40af-c026-4f7a-a07d-f852450c0713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "address": "fa:16:3e:56:83:68", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a8d2d7-d7", "ovs_interfaceid": "64a8d2d7-d71f-490b-b790-dfdca8b496c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "address": "fa:16:3e:b7:79:fc", "network": {"id": "387df2ed-7182-4954-bbd5-d03a94e2215c", "bridge": "br-int", "label": "tempest-device-tagging-net1-422265481", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12a4631cefff4ab3a81dcaeab669a0f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e3efc9d-4f", "ovs_interfaceid": "1e3efc9d-4f87-47c8-bdf6-f88cf14ba097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-f3ccb173-8c48-4638-bf86-5bd301778290 req-ed2f343f-9f01-47a9-b080-004c40b0f9df service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Detach interface failed, port_id=2bd68230-dccb-4d57-ae57-a5799925a6fc, reason: Instance 4f8e4516-738d-4440-938e-88ede5fe7b31 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:04:27 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:04:27 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:27 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:04:27 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Took 6.32 seconds to deallocate network for instance.
Oct 23 23:04:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:27 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Deleted allocations for instance 31c01877-ca5c-45cd-b85a-ec624b3e2a3f
Oct 23 23:04:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-775295c0-1e2b-4de8-91cc-28eeb82fbb84 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "31c01877-ca5c-45cd-b85a-ec624b3e2a3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.758s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-87c77859-f427-4598-abbf-f180f67fcdd2 req-1c479bc8-a100-492f-88a8-5173c62b8267 service nova] [instance: 31c01877-ca5c-45cd-b85a-ec624b3e2a3f] Received event network-vif-deleted-09c150b3-181b-47ed-b0b0-964e8d60f2e0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-05c9bd76-54a7-4300-8a00-b08b7f8e55da req-8ebdab90-1aa9-47bd-af27-7552db41a6ef service nova] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Received event network-vif-deleted-229b40af-c026-4f7a-a07d-f852450c0713 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:30 user nova-compute[74482]: INFO nova.compute.manager [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] [instance: 4f8e4516-738d-4440-938e-88ede5fe7b31] Took 2.96 seconds to detach 3 volumes for instance.
Oct 23 23:04:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:30 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:04:30 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:04:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:30 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Deleted allocations for instance 4f8e4516-738d-4440-938e-88ede5fe7b31
Oct 23 23:04:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-17377509-332d-44cd-9eca-8545ee2c5658 tempest-TaggedBootDevicesTest_v242-1551547892 tempest-TaggedBootDevicesTest_v242-1551547892-project-member] Lock "4f8e4516-738d-4440-938e-88ede5fe7b31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.915s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:04:49 user nova-compute[74482]: INFO nova.compute.claims [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Claim successful on node user
Oct 23 23:04:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:04:49 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.policy [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba4aeef9339f48d6929e4cfa97af0860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef228274d9477091fcd021ca8271e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:04:49 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Creating image(s)
Oct 23 23:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "/opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "/opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk 1073741824" returned: 0 in 0.069s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Successfully created port: 9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Cannot resize image /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Ensure instance console log exists: /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Successfully updated port: 9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquired lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-8b4d0f7a-4aa6-4a61-8bf3-46ed3ee3d3dd req-d09dc019-5442-4d47-8eb7-e1594121ccc8 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-changed-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-8b4d0f7a-4aa6-4a61-8bf3-46ed3ee3d3dd req-d09dc019-5442-4d47-8eb7-e1594121ccc8 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Refreshing instance network info cache due to event network-changed-9b2e69e1-e9e5-47ee-a252-cc7e568d4523. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8b4d0f7a-4aa6-4a61-8bf3-46ed3ee3d3dd req-d09dc019-5442-4d47-8eb7-e1594121ccc8 service nova] Acquiring lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updating instance_info_cache with network_info: [{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Releasing lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance network_info: |[{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8b4d0f7a-4aa6-4a61-8bf3-46ed3ee3d3dd req-d09dc019-5442-4d47-8eb7-e1594121ccc8 service nova] Acquired lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-8b4d0f7a-4aa6-4a61-8bf3-46ed3ee3d3dd req-d09dc019-5442-4d47-8eb7-e1594121ccc8 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Refreshing network info cache for port 9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Start _get_guest_xml network_info=[{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:04:51 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:51 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-439136322',display_name='tempest-AttachVolumeTestJSON-server-439136322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-439136322',id=15,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2iGfEXaPgxPn5izpripEi2/XY/bHunM2ZOKB1jTII0azdkSPatKwlT3TbO7EwNnoRFvRzERTAu0AuwvB5cbX4ENLG57+jsj++oymIjEa63YTDE00owdCA8Ukeap2uu+A==',key_name='tempest-keypair-837672835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-la2mgmq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=bbedc3ec-0f54-4977-8546-41ce4f488641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'pci_devices' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:04:51 user nova-compute[74482]:   <uuid>bbedc3ec-0f54-4977-8546-41ce4f488641</uuid>
Oct 23 23:04:51 user nova-compute[74482]:   <name>instance-0000000f</name>
Oct 23 23:04:51 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:04:51 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:04:51 user nova-compute[74482]:   <metadata>
Oct 23 23:04:51 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:04:51 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:04:51 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeTestJSON-server-439136322</nova:name>
Oct 23 23:04:51 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:04:51</nova:creationTime>
Oct 23 23:04:51 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:04:51 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:04:51 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:04:51 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:04:51 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:04:51 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:04:51 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:04:51 user nova-compute[74482]:       <nova:owner>
Oct 23 23:04:51 user nova-compute[74482]:         <nova:user uuid="ba4aeef9339f48d6929e4cfa97af0860">tempest-AttachVolumeTestJSON-1506893999-project-member</nova:user>
Oct 23 23:04:51 user nova-compute[74482]:         <nova:project uuid="5bef228274d9477091fcd021ca8271e3">tempest-AttachVolumeTestJSON-1506893999</nova:project>
Oct 23 23:04:51 user nova-compute[74482]:       </nova:owner>
Oct 23 23:04:51 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:04:51 user nova-compute[74482]:       <nova:ports>
Oct 23 23:04:51 user nova-compute[74482]:         <nova:port uuid="9b2e69e1-e9e5-47ee-a252-cc7e568d4523">
Oct 23 23:04:51 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 23:04:51 user nova-compute[74482]:         </nova:port>
Oct 23 23:04:51 user nova-compute[74482]:       </nova:ports>
Oct 23 23:04:51 user nova-compute[74482]:     </nova:instance>
Oct 23 23:04:51 user nova-compute[74482]:   </metadata>
Oct 23 23:04:51 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:04:51 user nova-compute[74482]:     <system>
Oct 23 23:04:51 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:04:51 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:04:51 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:04:51 user nova-compute[74482]:       <entry name="serial">bbedc3ec-0f54-4977-8546-41ce4f488641</entry>
Oct 23 23:04:51 user nova-compute[74482]:       <entry name="uuid">bbedc3ec-0f54-4977-8546-41ce4f488641</entry>
Oct 23 23:04:51 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:04:51 user nova-compute[74482]:     </system>
Oct 23 23:04:51 user nova-compute[74482]:   </sysinfo>
Oct 23 23:04:51 user nova-compute[74482]:   <os>
Oct 23 23:04:51 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:04:51 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:04:51 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:04:51 user nova-compute[74482]:   </os>
Oct 23 23:04:51 user nova-compute[74482]:   <features>
Oct 23 23:04:51 user nova-compute[74482]:     <acpi/>
Oct 23 23:04:51 user nova-compute[74482]:     <apic/>
Oct 23 23:04:51 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:04:51 user nova-compute[74482]:   </features>
Oct 23 23:04:51 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:04:51 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:04:51 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:04:51 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:04:51 user nova-compute[74482]:   </clock>
Oct 23 23:04:51 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:04:51 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:04:51 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:04:51 user nova-compute[74482]:   </cpu>
Oct 23 23:04:51 user nova-compute[74482]:   <devices>
Oct 23 23:04:51 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:04:51 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:04:51 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk"/>
Oct 23 23:04:51 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:04:51 user nova-compute[74482]:     </disk>
Oct 23 23:04:51 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:04:51 user nova-compute[74482]:       <mac address="fa:16:3e:f4:77:36"/>
Oct 23 23:04:51 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:51 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:04:51 user nova-compute[74482]:       <target dev="tap9b2e69e1-e9"/>
Oct 23 23:04:51 user nova-compute[74482]:     </interface>
Oct 23 23:04:51 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:04:51 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/console.log" append="off"/>
Oct 23 23:04:51 user nova-compute[74482]:     </serial>
Oct 23 23:04:51 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:04:51 user nova-compute[74482]:     <video>
Oct 23 23:04:51 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:04:51 user nova-compute[74482]:     </video>
Oct 23 23:04:51 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:04:51 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:04:51 user nova-compute[74482]:     </rng>
Oct 23 23:04:51 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:04:51 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:04:51 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:04:51 user nova-compute[74482]:     </memballoon>
Oct 23 23:04:51 user nova-compute[74482]:   </devices>
Oct 23 23:04:51 user nova-compute[74482]: </domain>
Oct 23 23:04:51 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-439136322',display_name='tempest-AttachVolumeTestJSON-server-439136322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-439136322',id=15,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2iGfEXaPgxPn5izpripEi2/XY/bHunM2ZOKB1jTII0azdkSPatKwlT3TbO7EwNnoRFvRzERTAu0AuwvB5cbX4ENLG57+jsj++oymIjEa63YTDE00owdCA8Ukeap2uu+A==',key_name='tempest-keypair-837672835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-la2mgmq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=bbedc3ec-0f54-4977-8546-41ce4f488641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG os_vif [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd01e535d-6286-5015-ae64-9329ce9105df', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b2e69e1-e9, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b2e69e1-e9, col_values=(('qos', UUID('d4b1a2c8-60ac-448f-a45b-a9e1b937e72b')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b2e69e1-e9, col_values=(('external_ids', {'iface-id': '9b2e69e1-e9e5-47ee-a252-cc7e568d4523', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:77:36', 'vm-uuid': 'bbedc3ec-0f54-4977-8546-41ce4f488641'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:51 user nova-compute[74482]: INFO os_vif [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9')
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:04:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No VIF found with MAC fa:16:3e:f4:77:36, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-8b4d0f7a-4aa6-4a61-8bf3-46ed3ee3d3dd req-d09dc019-5442-4d47-8eb7-e1594121ccc8 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updated VIF entry in instance network info cache for port 9b2e69e1-e9e5-47ee-a252-cc7e568d4523. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-8b4d0f7a-4aa6-4a61-8bf3-46ed3ee3d3dd req-d09dc019-5442-4d47-8eb7-e1594121ccc8 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updating instance_info_cache with network_info: [{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8b4d0f7a-4aa6-4a61-8bf3-46ed3ee3d3dd req-d09dc019-5442-4d47-8eb7-e1594121ccc8 service nova] Releasing lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-75af787b-c5f9-431e-9a1f-efc3afb5c7f5 req-d06304f1-baf1-4281-af9a-cf1be3f2a45b service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-changed-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-75af787b-c5f9-431e-9a1f-efc3afb5c7f5 req-d06304f1-baf1-4281-af9a-cf1be3f2a45b service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Refreshing instance network info cache due to event network-changed-f4d3d364-6576-469e-b136-32509ea1bef0. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-75af787b-c5f9-431e-9a1f-efc3afb5c7f5 req-d06304f1-baf1-4281-af9a-cf1be3f2a45b service nova] Acquiring lock "refresh_cache-2a91897d-e83c-4396-8584-c8ff4fcfc553" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-75af787b-c5f9-431e-9a1f-efc3afb5c7f5 req-d06304f1-baf1-4281-af9a-cf1be3f2a45b service nova] Acquired lock "refresh_cache-2a91897d-e83c-4396-8584-c8ff4fcfc553" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-75af787b-c5f9-431e-9a1f-efc3afb5c7f5 req-d06304f1-baf1-4281-af9a-cf1be3f2a45b service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Refreshing network info cache for port f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-75af787b-c5f9-431e-9a1f-efc3afb5c7f5 req-d06304f1-baf1-4281-af9a-cf1be3f2a45b service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Updated VIF entry in instance network info cache for port f4d3d364-6576-469e-b136-32509ea1bef0. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-75af787b-c5f9-431e-9a1f-efc3afb5c7f5 req-d06304f1-baf1-4281-af9a-cf1be3f2a45b service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Updating instance_info_cache with network_info: [{"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-75af787b-c5f9-431e-9a1f-efc3afb5c7f5 req-d06304f1-baf1-4281-af9a-cf1be3f2a45b service nova] Releasing lock "refresh_cache-2a91897d-e83c-4396-8584-c8ff4fcfc553" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG nova.objects.instance [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'flavor' on Instance uuid 2a91897d-e83c-4396-8584-c8ff4fcfc553 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:52 user nova-compute[74482]: INFO nova.compute.manager [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Attaching volume 926911cd-cb13-410d-80a2-b33f3d262b62 to /dev/vdb
Oct 23 23:04:52 user nova-compute[74482]: DEBUG os_brick.utils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e42f52f-ebe9-4229-8831-147178f4eca9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218ab25-334a-4d7d-9a23-cb1c3fca2aff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[445053f1-2d2d-4761-950c-f5ee91c92d26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81b868c-dee8-46cb-9bbe-fe576fce9f1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:04:53 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:04:53 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bde66d2-b0ea-4942-b01a-08b09f67abab]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG os_brick.utils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Updating existing volume attachment record: 7e52b3b3-549c-4da1-b186-4468c6f81c0a {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:54 user nova-compute[74482]: WARNING nova.compute.manager [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state building and task_state spawning.
Oct 23 23:04:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:04:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:04:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:04:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:04:54 user nova-compute[74482]: WARNING nova.compute.manager [req-6609799f-7b7d-4f73-804d-297e70fa5d28 req-7ac494e7-2444-442b-a0c3-fcaa55172132 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state building and task_state spawning.
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:04:55 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance spawned successfully.
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:04:55 user nova-compute[74482]: INFO nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Took 5.68 seconds to spawn the instance on the hypervisor.
Oct 23 23:04:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:04:55 user nova-compute[74482]: INFO nova.compute.manager [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Took 6.52 seconds to build instance.
Oct 23 23:04:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7c3fb590-3768-41eb-822f-a9f04c7697d6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.670s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:04:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:04:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:05:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:05:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updating instance_info_cache with network_info: [{"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:05:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:05:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:05:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:05:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_power_states {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid fc2566c6-8911-425b-b05d-a008e67a9d34 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid aa063829-b117-40f4-93f2-358b33f1d156 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid c7e4371a-32f9-4156-bea9-b7c4b5df3100 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 2a91897d-e83c-4396-8584-c8ff4fcfc553 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "fc2566c6-8911-425b-b05d-a008e67a9d34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "aa063829-b117-40f4-93f2-358b33f1d156" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "95802cf3-56ba-4224-a333-e00e54c72166" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "aa063829-b117-40f4-93f2-358b33f1d156" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "95802cf3-56ba-4224-a333-e00e54c72166" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:05:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThXYdgFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:05:12 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:05:12 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:05:12 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05d16e4-afb9-4b5a-8d40-7ca9409134dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:05:12 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a3b1f2-8de8-44ed-b016-91d190de9b59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62] added
Oct 23 23:05:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a13752-8ed9-4eb6-8d77-c228ed93cd57]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4356e6-ee23-43e4-8e76-047b54f47284]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThXYdgFf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThXYdgFf" returned: 0 in 0.061s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b3fe7c-e947-49c4-a5a0-ac33a4c8c0b8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ThXYdgFf'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1645e4-1577-4b6c-8882-a13ee6d5ecf0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3b9f39-b609-4a43-b9a6-8f41dfde7949]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a81f38-7578-4c35-b28b-16f6b8201ba1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260]
Oct 23 23:05:13 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260] successful.
Oct 23 23:05:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2977bd-c407-4f62-9384-a9b5f1dc79bd]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca68bb-2ca0-4dd3-b61e-b72b88b700f0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc350796-0782-482f-9743-42bba12118a5]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThXYdgFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:13 user nova-compute[74482]: INFO nova.compute.manager [None req-7a11fb63-48e6-4620-81bf-d0e6278bc1e1 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Unrescuing
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7a11fb63-48e6-4620-81bf-d0e6278bc1e1 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7a11fb63-48e6-4620-81bf-d0e6278bc1e1 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquired lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:13 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7a11fb63-48e6-4620-81bf-d0e6278bc1e1 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.514s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== connect_volume: return (1519ms) {'type': 'block', 'scsi_wwn': '26432623039663266', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432623039663266', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'flavor' on Instance uuid 2a91897d-e83c-4396-8584-c8ff4fcfc553 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:05:14 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:05:14 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:05:14 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:05:14 user nova-compute[74482]:   <serial>926911cd-cb13-410d-80a2-b33f3d262b62</serial>
Oct 23 23:05:14 user nova-compute[74482]: </disk>
Oct 23 23:05:14 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No VIF found with MAC fa:16:3e:68:49:59, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:14 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7a11fb63-48e6-4620-81bf-d0e6278bc1e1 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating instance_info_cache with network_info: [{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7a11fb63-48e6-4620-81bf-d0e6278bc1e1 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Releasing lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7a11fb63-48e6-4620-81bf-d0e6278bc1e1 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'flavor' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78cc3da7-a06a-4627-998a-fd09444c334c tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.373s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.952s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-571d6bcd-637f-475e-b332-9527fa9ce97d req-c389d633-6929-4a27-9937-220b1a9991d7 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-unplugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-571d6bcd-637f-475e-b332-9527fa9ce97d req-c389d633-6929-4a27-9937-220b1a9991d7 service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-571d6bcd-637f-475e-b332-9527fa9ce97d req-c389d633-6929-4a27-9937-220b1a9991d7 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-571d6bcd-637f-475e-b332-9527fa9ce97d req-c389d633-6929-4a27-9937-220b1a9991d7 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-571d6bcd-637f-475e-b332-9527fa9ce97d req-c389d633-6929-4a27-9937-220b1a9991d7 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-unplugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:15 user nova-compute[74482]: WARNING nova.compute.manager [req-571d6bcd-637f-475e-b332-9527fa9ce97d req-c389d633-6929-4a27-9937-220b1a9991d7 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-unplugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-d7c51ca1-45eb-46f0-b45e-9c7a89b8d322 req-f03067c3-db8c-4647-8cd7-e257cd9ca420 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-changed-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-d7c51ca1-45eb-46f0-b45e-9c7a89b8d322 req-f03067c3-db8c-4647-8cd7-e257cd9ca420 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Refreshing instance network info cache due to event network-changed-dddb3b05-0e78-459a-ae09-5db2fd55bf4c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d7c51ca1-45eb-46f0-b45e-9c7a89b8d322 req-f03067c3-db8c-4647-8cd7-e257cd9ca420 service nova] Acquiring lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d7c51ca1-45eb-46f0-b45e-9c7a89b8d322 req-f03067c3-db8c-4647-8cd7-e257cd9ca420 service nova] Acquired lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG nova.network.neutron [req-d7c51ca1-45eb-46f0-b45e-9c7a89b8d322 req-f03067c3-db8c-4647-8cd7-e257cd9ca420 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Refreshing network info cache for port dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:15 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Instance destroyed successfully.
Oct 23 23:05:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG nova.network.neutron [req-d7c51ca1-45eb-46f0-b45e-9c7a89b8d322 req-f03067c3-db8c-4647-8cd7-e257cd9ca420 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updated VIF entry in instance network info cache for port dddb3b05-0e78-459a-ae09-5db2fd55bf4c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG nova.network.neutron [req-d7c51ca1-45eb-46f0-b45e-9c7a89b8d322 req-f03067c3-db8c-4647-8cd7-e257cd9ca420 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating instance_info_cache with network_info: [{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d7c51ca1-45eb-46f0-b45e-9c7a89b8d322 req-f03067c3-db8c-4647-8cd7-e257cd9ca420 service nova] Releasing lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:05:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:20 user nova-compute[74482]: INFO nova.compute.manager [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Rebuilding instance
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7a11fb63-48e6-4620-81bf-d0e6278bc1e1 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-f53fd664-b15e-46f7-957b-49919fb1ad23 req-6baa3fe1-6644-4283-ae04-850f9d0c8b83 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f53fd664-b15e-46f7-957b-49919fb1ad23 req-6baa3fe1-6644-4283-ae04-850f9d0c8b83 service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f53fd664-b15e-46f7-957b-49919fb1ad23 req-6baa3fe1-6644-4283-ae04-850f9d0c8b83 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f53fd664-b15e-46f7-957b-49919fb1ad23 req-6baa3fe1-6644-4283-ae04-850f9d0c8b83 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-f53fd664-b15e-46f7-957b-49919fb1ad23 req-6baa3fe1-6644-4283-ae04-850f9d0c8b83 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:20 user nova-compute[74482]: WARNING nova.compute.manager [req-f53fd664-b15e-46f7-957b-49919fb1ad23 req-6baa3fe1-6644-4283-ae04-850f9d0c8b83 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-e0777b34-ee89-4291-81f6-845e941884b2 req-8fb1bbdc-96f6-40f9-834e-e510fa5965c5 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-changed-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-e0777b34-ee89-4291-81f6-845e941884b2 req-8fb1bbdc-96f6-40f9-834e-e510fa5965c5 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Refreshing instance network info cache due to event network-changed-dddb3b05-0e78-459a-ae09-5db2fd55bf4c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e0777b34-ee89-4291-81f6-845e941884b2 req-8fb1bbdc-96f6-40f9-834e-e510fa5965c5 service nova] Acquiring lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e0777b34-ee89-4291-81f6-845e941884b2 req-8fb1bbdc-96f6-40f9-834e-e510fa5965c5 service nova] Acquired lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-e0777b34-ee89-4291-81f6-845e941884b2 req-8fb1bbdc-96f6-40f9-834e-e510fa5965c5 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Refreshing network info cache for port dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:20 user nova-compute[74482]: WARNING nova.compute.manager [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:20 user nova-compute[74482]: WARNING nova.compute.manager [req-27544bc7-2438-451e-bb39-2341b669d290 req-19d761f0-03d8-4b97-bb39-4ff3c6a934fb service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:05:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:05:20 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:05:20 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7277MB free_disk=25.05865478515625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Applying migration context for instance aa063829-b117-40f4-93f2-358b33f1d156 as it has an incoming, in-progress migration 1038afda-29ba-4303-9327-eb047061724b. Migration status is reverting {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 23:05:20 user nova-compute[74482]: INFO nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating resource usage from migration 1038afda-29ba-4303-9327-eb047061724b
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Port 26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 binding to destination host user is already ACTIVE {{(pid=74482) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquired lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Migration 1038afda-29ba-4303-9327-eb047061724b is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa063829-b117-40f4-93f2-358b33f1d156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 3b4dc4ee-2f24-46b1-a327-e7b8242e6992 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-e0777b34-ee89-4291-81f6-845e941884b2 req-8fb1bbdc-96f6-40f9-834e-e510fa5965c5 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updated VIF entry in instance network info cache for port dddb3b05-0e78-459a-ae09-5db2fd55bf4c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-e0777b34-ee89-4291-81f6-845e941884b2 req-8fb1bbdc-96f6-40f9-834e-e510fa5965c5 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating instance_info_cache with network_info: [{"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e0777b34-ee89-4291-81f6-845e941884b2 req-8fb1bbdc-96f6-40f9-834e-e510fa5965c5 service nova] Releasing lock "refresh_cache-21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.008s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.768s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:05:21 user nova-compute[74482]: INFO nova.compute.claims [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Claim successful on node user
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance_info_cache with network_info: [{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Releasing lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Creating tmpfile /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/tmps2r1dwhm to verify with other compute node that the instance is on the same shared storage. {{(pid=74482) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 23 23:05:21 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Instance destroyed successfully.
Oct 23 23:05:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:21 user nova-compute[74482]: INFO nova.compute.manager [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Detaching volume 926911cd-cb13-410d-80a2-b33f3d262b62
Oct 23 23:05:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:21 user nova-compute[74482]: INFO nova.virt.block_device [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Attempting to driver detach volume 926911cd-cb13-410d-80a2-b33f3d262b62 from mountpoint /dev/vdb
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-unplugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] No waiting events found dispatching network-vif-unplugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:21 user nova-compute[74482]: WARNING nova.compute.manager [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received unexpected event network-vif-unplugged-f4d3d364-6576-469e-b136-32509ea1bef0 for instance with vm_state active and task_state rebuilding.
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] No waiting events found dispatching network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:21 user nova-compute[74482]: WARNING nova.compute.manager [req-45c8e259-1055-4f9d-a0cc-14ee508ef01b req-7ab763ac-8351-4cab-8403-ade12a61746f service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received unexpected event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 for instance with vm_state active and task_state rebuilding.
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Attempting to detach device vdb from instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:05:21 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:05:21 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:05:21 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:05:21 user nova-compute[74482]:   <serial>926911cd-cb13-410d-80a2-b33f3d262b62</serial>
Oct 23 23:05:21 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:05:21 user nova-compute[74482]: </disk>
Oct 23 23:05:21 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:05:21 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully detached device vdb from instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 from the persistent domain config.
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThXYdgFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:05:21 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[737de50e-fc9a-42a5-9b8e-8ccc39f67e2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:05:21 user nova-compute[74482]: No targets found.
Oct 23 23:05:21 user nova-compute[74482]: iSNS:
Oct 23 23:05:21 user nova-compute[74482]: No targets found.
Oct 23 23:05:21 user nova-compute[74482]: STATIC:
Oct 23 23:05:21 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:05:21 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:05:21 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:05:21 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:05:21 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:05:21 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:05:21 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62
Oct 23 23:05:21 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:05:21 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:05:21 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:05:21 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:05:21 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:05:21 user nova-compute[74482]: FIRMWARE:
Oct 23 23:05:21 user nova-compute[74482]: No targets found.
Oct 23 23:05:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:05:21 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:05:21 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf61101d-b711-464c-8d21-9d0a613683e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-22db304c-2cc1-406c-bd99-6c1d6a0133ce req-11f495dd-e786-4ee3-a587-4417b86c37db service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-22db304c-2cc1-406c-bd99-6c1d6a0133ce req-11f495dd-e786-4ee3-a587-4417b86c37db service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-22db304c-2cc1-406c-bd99-6c1d6a0133ce req-11f495dd-e786-4ee3-a587-4417b86c37db service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-22db304c-2cc1-406c-bd99-6c1d6a0133ce req-11f495dd-e786-4ee3-a587-4417b86c37db service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-22db304c-2cc1-406c-bd99-6c1d6a0133ce req-11f495dd-e786-4ee3-a587-4417b86c37db service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:21 user nova-compute[74482]: WARNING nova.compute.manager [req-22db304c-2cc1-406c-bd99-6c1d6a0133ce req-11f495dd-e786-4ee3-a587-4417b86c37db service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state resized and task_state resize_reverting.
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[15477c17-5205-4583-a1b7-459a6a985a1a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:21 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:21 user nova-compute[74482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:05:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:21 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:21 user nova-compute[74482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:05:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c754430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebf4081-75f0-4f30-a1e2-5de9bd43f996]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc17d1b-f576-4cd7-a4b4-edbd1c0b1fb7]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3da7d2-4585-4a93-a55c-d0126b57dbc1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.762s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7b4b77-575b-49eb-bfa1-348fcc282c94]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd065b72-836b-4d06-9965-ae87dcd57ea7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:05:22 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[839e8a91-7073-487f-9519-c0411dd2814a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260]
Oct 23 23:05:22 user nova-compute[74482]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260] successful.
Oct 23 23:05:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9fecd2-f503-427d-8cba-cc221257fbd7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== disconnect_volume: return (434ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.policy [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '875daa8820804264a89ecfc2c6884fa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a325a57cab5d4baea61d50a50d520b1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance destroyed successfully.
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lazy-loading 'resources' on Instance uuid aa063829-b117-40f4-93f2-358b33f1d156 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1895303322',display_name='tempest-ServerActionsTestOtherB-server-1895303322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1895303322',id=2,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtTCYnjLWuZ5ND071jtsoNL+jCbUBIt9fx3Xpn4EVHhYK3Fa774GNC5Gw1NBdqzVTnVApUJDfyn5fEVDoKQTbN3TLPt6wiaiOSOkoESIbi/mWxf/f66vq9c/4Twd5CY7Q==',key_name='tempest-keypair-2026660343',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69039bafbadf4db8862003e2483fc973',ramdisk_id='',reservation_id='r-ejmhk03v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-598393554',owner_user_name='tempest-ServerActionsTestOtherB-598393554-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad45a40b18f4217924249b71fd4c93d',uuid=aa063829-b117-40f4-93f2-358b33f1d156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converting VIF {"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_vif [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:05:22 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Creating image(s)
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "/opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "/opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26dfbe86-37, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab8b01d8-c393-44de-80f3-5d3dd587d718) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:22 user nova-compute[74482]: INFO os_vif [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37')
Oct 23 23:05:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:05:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27c86ad-a0bc-425b-98c7-848f3aa2e656]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:05:22 user nova-compute[74482]: No targets found.
Oct 23 23:05:22 user nova-compute[74482]: iSNS:
Oct 23 23:05:22 user nova-compute[74482]: No targets found.
Oct 23 23:05:22 user nova-compute[74482]: STATIC:
Oct 23 23:05:22 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:05:22 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:05:22 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:05:22 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:05:22 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:05:22 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:05:22 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:05:22 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:05:22 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:05:22 user nova-compute[74482]: FIRMWARE:
Oct 23 23:05:22 user nova-compute[74482]: No targets found.
Oct 23 23:05:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:05:22 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:05:22 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8740ba0f-3380-40a1-82fc-b6ccd17d21ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7e7d1b-63a8-4746-8f62-ee983016b4b8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:22 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:22 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:22 user nova-compute[74482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:22 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c90e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368'): ({'sdg'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Removing single pathed devices sdg {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[05542572-199a-47be-8a61-0e8320c90be8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.034s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e0c9bd-fdaa-4268-9dfb-b3989e98ccff]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Flushing IO for device /dev/sdg {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.311s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ad9c49-bf1d-4822-a27f-813e027269a7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b708d4-38dd-4638-8fbf-28ce579d3ba9]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] SCSI volumes sdg have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e5d7ad-ddf3-4bd7-86d5-4e23432ce540]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.208s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[be076a08-b82d-43b2-a2f5-43dd9c3e17c4]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]
Oct 23 23:05:23 user nova-compute[74482]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.
Oct 23 23:05:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk 1073741824" returned: 0 in 0.061s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c119190-ce5f-40d4-ae4a-fcf862ad517e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.549s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] <== disconnect_volume: return (554ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.242s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:23 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Instance destroyed successfully.
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1405955470',display_name='tempest-ServerActionsTestOtherA-server-466596655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1405955470',id=13,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+kFDD4wwJWW/1hObOOzjmoSpoVE08++Rl7M3rZ7hasNILrz2Hts0rh2BR+TeMo8ArCwaM5O7vBiIcCD76Cv0A5UMS3pbhQxU/biWWpIfcmTYASw0GYH12Hz9/vT8pENw==',key_name='tempest-keypair-25770726',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-wps4jnhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:05:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=2a91897d-e83c-4396-8584-c8ff4fcfc553,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_vif [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4d3d364-65, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a633191f-8d23-47e9-8c01-f1efa7ac2886) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:05:23 user nova-compute[74482]: INFO os_vif [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65')
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThXYdgFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:05:23 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Successfully created port: 1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab89f9-97b2-43c9-9abd-397f8caba8a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:05:23 user nova-compute[74482]: No targets found.
Oct 23 23:05:23 user nova-compute[74482]: iSNS:
Oct 23 23:05:23 user nova-compute[74482]: No targets found.
Oct 23 23:05:23 user nova-compute[74482]: STATIC:
Oct 23 23:05:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:05:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:05:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:05:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:05:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:05:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:05:23 user nova-compute[74482]: FIRMWARE:
Oct 23 23:05:23 user nova-compute[74482]: No targets found.
Oct 23 23:05:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:05:23 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:05:23 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d036816-3719-4bb9-bd1a-a488edc61abb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Cannot resize image /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Ensure instance console log exists: /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8339af63-a82f-40f0-8a1a-63afbaa606ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:23 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:23 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c5503a0>, {}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Disconnecting from: [] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== disconnect_volume: return (100ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:05:23 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Deleting instance files /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553_del
Oct 23 23:05:23 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Deletion of /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553_del complete
Oct 23 23:05:23 user nova-compute[74482]: INFO nova.virt.block_device [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Booting with volume 926911cd-cb13-410d-80a2-b33f3d262b62 at /dev/vdb
Oct 23 23:05:23 user nova-compute[74482]: DEBUG os_brick.utils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85e3c5d-a9ea-406e-94c3-acfb1f505ac8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2506b174-134e-43ad-bebf-3cbc394bb9c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[af79ff9f-a05e-4f38-a9de-0dd21351951a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a0aa5b-8e74-443b-875d-a0ce817cb366]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:24 user nova-compute[74482]: WARNING nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state resized and task_state resize_reverting.
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:24 user nova-compute[74482]: WARNING nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state resized and task_state resize_reverting.
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:24 user nova-compute[74482]: WARNING nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state resized and task_state resize_reverting.
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:24 user nova-compute[74482]: WARNING nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state resized and task_state resize_reverting.
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:24 user nova-compute[74482]: WARNING nova.compute.manager [req-ea64be5a-05bb-4c83-92da-0422754a494e req-f8377cc9-f42a-46cd-bf07-51e07ae2bd0f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state resized and task_state resize_reverting.
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:05:24 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[886989fa-8eab-4798-bc18-dcf8e37fc56d]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG os_brick.utils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Updating existing volume attachment record: 9fa3cbb0-a327-4b8e-820d-fdb85ec47934 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Successfully updated port: 1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "refresh_cache-3b4dc4ee-2f24-46b1-a327-e7b8242e6992" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquired lock "refresh_cache-3b4dc4ee-2f24-46b1-a327-e7b8242e6992" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ffa205bf-168f-4906-ad23-99609cd9c65a req-519dd877-3783-4239-97a0-d46cf8f24a80 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received event network-changed-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-ffa205bf-168f-4906-ad23-99609cd9c65a req-519dd877-3783-4239-97a0-d46cf8f24a80 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Refreshing instance network info cache due to event network-changed-1ace7343-041a-42b1-b1aa-2a3e34b86c96. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ffa205bf-168f-4906-ad23-99609cd9c65a req-519dd877-3783-4239-97a0-d46cf8f24a80 service nova] Acquiring lock "refresh_cache-3b4dc4ee-2f24-46b1-a327-e7b8242e6992" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lazy-loading 'migration_context' on Instance uuid aa063829-b117-40f4-93f2-358b33f1d156 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.objects.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Object Instance<aa063829-b117-40f4-93f2-358b33f1d156> lazy-loaded attributes: resources,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Updating instance_info_cache with network_info: [{"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Releasing lock "refresh_cache-3b4dc4ee-2f24-46b1-a327-e7b8242e6992" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Instance network_info: |[{"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ffa205bf-168f-4906-ad23-99609cd9c65a req-519dd877-3783-4239-97a0-d46cf8f24a80 service nova] Acquired lock "refresh_cache-3b4dc4ee-2f24-46b1-a327-e7b8242e6992" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.network.neutron [req-ffa205bf-168f-4906-ad23-99609cd9c65a req-519dd877-3783-4239-97a0-d46cf8f24a80 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Refreshing network info cache for port 1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Start _get_guest_xml network_info=[{"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:05:24 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:05:24 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1642845092',display_name='tempest-VolumesActionsTest-instance-1642845092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1642845092',id=16,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a325a57cab5d4baea61d50a50d520b1c',ramdisk_id='',reservation_id='r-tx6tokvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-732614350',owner_user_name='tempest-VolumesActionsTest-732614350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:05:22Z,user_data=None,user_id='875daa8820804264a89ecfc2c6884fa1',uuid=3b4dc4ee-2f24-46b1-a327-e7b8242e6992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converting VIF {"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:c0,bridge_name='br-int',has_traffic_filtering=True,id=1ace7343-041a-42b1-b1aa-2a3e34b86c96,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace7343-04') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b4dc4ee-2f24-46b1-a327-e7b8242e6992 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:05:24 user nova-compute[74482]:   <uuid>3b4dc4ee-2f24-46b1-a327-e7b8242e6992</uuid>
Oct 23 23:05:24 user nova-compute[74482]:   <name>instance-00000010</name>
Oct 23 23:05:24 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:05:24 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:05:24 user nova-compute[74482]:   <metadata>
Oct 23 23:05:24 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:05:24 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:05:24 user nova-compute[74482]:       <nova:name>tempest-VolumesActionsTest-instance-1642845092</nova:name>
Oct 23 23:05:24 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:05:24</nova:creationTime>
Oct 23 23:05:24 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:05:24 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:05:24 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:05:24 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:05:24 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:05:24 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:05:24 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:05:24 user nova-compute[74482]:       <nova:owner>
Oct 23 23:05:24 user nova-compute[74482]:         <nova:user uuid="875daa8820804264a89ecfc2c6884fa1">tempest-VolumesActionsTest-732614350-project-member</nova:user>
Oct 23 23:05:24 user nova-compute[74482]:         <nova:project uuid="a325a57cab5d4baea61d50a50d520b1c">tempest-VolumesActionsTest-732614350</nova:project>
Oct 23 23:05:24 user nova-compute[74482]:       </nova:owner>
Oct 23 23:05:24 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:05:24 user nova-compute[74482]:       <nova:ports>
Oct 23 23:05:24 user nova-compute[74482]:         <nova:port uuid="1ace7343-041a-42b1-b1aa-2a3e34b86c96">
Oct 23 23:05:24 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 23:05:24 user nova-compute[74482]:         </nova:port>
Oct 23 23:05:24 user nova-compute[74482]:       </nova:ports>
Oct 23 23:05:24 user nova-compute[74482]:     </nova:instance>
Oct 23 23:05:24 user nova-compute[74482]:   </metadata>
Oct 23 23:05:24 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:05:24 user nova-compute[74482]:     <system>
Oct 23 23:05:24 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:05:24 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:05:24 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:05:24 user nova-compute[74482]:       <entry name="serial">3b4dc4ee-2f24-46b1-a327-e7b8242e6992</entry>
Oct 23 23:05:24 user nova-compute[74482]:       <entry name="uuid">3b4dc4ee-2f24-46b1-a327-e7b8242e6992</entry>
Oct 23 23:05:24 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:05:24 user nova-compute[74482]:     </system>
Oct 23 23:05:24 user nova-compute[74482]:   </sysinfo>
Oct 23 23:05:24 user nova-compute[74482]:   <os>
Oct 23 23:05:24 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:05:24 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:05:24 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:05:24 user nova-compute[74482]:   </os>
Oct 23 23:05:24 user nova-compute[74482]:   <features>
Oct 23 23:05:24 user nova-compute[74482]:     <acpi/>
Oct 23 23:05:24 user nova-compute[74482]:     <apic/>
Oct 23 23:05:24 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:05:24 user nova-compute[74482]:   </features>
Oct 23 23:05:24 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:05:24 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:05:24 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:05:24 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:05:24 user nova-compute[74482]:   </clock>
Oct 23 23:05:24 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:05:24 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:05:24 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:05:24 user nova-compute[74482]:   </cpu>
Oct 23 23:05:24 user nova-compute[74482]:   <devices>
Oct 23 23:05:24 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:05:24 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:05:24 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk"/>
Oct 23 23:05:24 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:05:24 user nova-compute[74482]:     </disk>
Oct 23 23:05:24 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:05:24 user nova-compute[74482]:       <mac address="fa:16:3e:ba:2a:c0"/>
Oct 23 23:05:24 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:05:24 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:05:24 user nova-compute[74482]:       <target dev="tap1ace7343-04"/>
Oct 23 23:05:24 user nova-compute[74482]:     </interface>
Oct 23 23:05:24 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:05:24 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/console.log" append="off"/>
Oct 23 23:05:24 user nova-compute[74482]:     </serial>
Oct 23 23:05:24 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:05:24 user nova-compute[74482]:     <video>
Oct 23 23:05:24 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:05:24 user nova-compute[74482]:     </video>
Oct 23 23:05:24 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:05:24 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:05:24 user nova-compute[74482]:     </rng>
Oct 23 23:05:24 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:05:24 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:05:24 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:05:24 user nova-compute[74482]:     </memballoon>
Oct 23 23:05:24 user nova-compute[74482]:   </devices>
Oct 23 23:05:24 user nova-compute[74482]: </domain>
Oct 23 23:05:24 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1642845092',display_name='tempest-VolumesActionsTest-instance-1642845092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1642845092',id=16,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a325a57cab5d4baea61d50a50d520b1c',ramdisk_id='',reservation_id='r-tx6tokvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-732614350',owner_user_name='tempest-VolumesActionsTest-732614350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:05:22Z,user_data=None,user_id='875daa8820804264a89ecfc2c6884fa1',uuid=3b4dc4ee-2f24-46b1-a327-e7b8242e6992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converting VIF {"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:c0,bridge_name='br-int',has_traffic_filtering=True,id=1ace7343-041a-42b1-b1aa-2a3e34b86c96,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace7343-04') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG os_vif [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:c0,bridge_name='br-int',has_traffic_filtering=True,id=1ace7343-041a-42b1-b1aa-2a3e34b86c96,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace7343-04') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c6adbe9-6eaf-57dd-adae-1097a15a2b7e', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ace7343-04, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ace7343-04, col_values=(('qos', UUID('b1e35908-0c59-4ff8-b54e-f8c7203efc23')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ace7343-04, col_values=(('external_ids', {'iface-id': '1ace7343-041a-42b1-b1aa-2a3e34b86c96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:2a:c0', 'vm-uuid': '3b4dc4ee-2f24-46b1-a327-e7b8242e6992'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:24 user nova-compute[74482]: INFO os_vif [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:c0,bridge_name='br-int',has_traffic_filtering=True,id=1ace7343-041a-42b1-b1aa-2a3e34b86c96,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace7343-04')
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:05:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] No VIF found with MAC fa:16:3e:ba:2a:c0, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.672s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG nova.network.neutron [req-ffa205bf-168f-4906-ad23-99609cd9c65a req-519dd877-3783-4239-97a0-d46cf8f24a80 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Updated VIF entry in instance network info cache for port 1ace7343-041a-42b1-b1aa-2a3e34b86c96. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG nova.network.neutron [req-ffa205bf-168f-4906-ad23-99609cd9c65a req-519dd877-3783-4239-97a0-d46cf8f24a80 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Updating instance_info_cache with network_info: [{"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:25 user nova-compute[74482]: INFO nova.compute.manager [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Swapping old allocation on dict_keys(['1a363ec4-e397-463d-b641-d9da25942aa6']) held by migration 1038afda-29ba-4303-9327-eb047061724b for instance
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ffa205bf-168f-4906-ad23-99609cd9c65a req-519dd877-3783-4239-97a0-d46cf8f24a80 service nova] Releasing lock "refresh_cache-3b4dc4ee-2f24-46b1-a327-e7b8242e6992" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Overwriting current allocation {'allocations': {'1a363ec4-e397-463d-b641-d9da25942aa6': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 20}}, 'project_id': '69039bafbadf4db8862003e2483fc973', 'user_id': '8ad45a40b18f4217924249b71fd4c93d', 'consumer_generation': 1} on consumer aa063829-b117-40f4-93f2-358b33f1d156 {{(pid=74482) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquired lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance_info_cache with network_info: [{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Releasing lock "refresh_cache-aa063829-b117-40f4-93f2-358b33f1d156" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG os_brick.utils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a76e9a7-89c1-428b-84f2-d997d3a603b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a7317-7e22-4267-8c00-ec8d545b8bcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45a426d-1cb0-458c-b63d-71be654da5cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a944d39-4a0b-4be0-9738-6555ff14702d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:05:26 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e528052-bbd0-42c9-ab06-fd117bea030f]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG os_brick.utils [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-adadf76c-26b3-42df-892d-8a93be12216f req-56bb2333-cecd-4889-9814-c431f4a0abf0 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received event network-vif-plugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-adadf76c-26b3-42df-892d-8a93be12216f req-56bb2333-cecd-4889-9814-c431f4a0abf0 service nova] Acquiring lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-adadf76c-26b3-42df-892d-8a93be12216f req-56bb2333-cecd-4889-9814-c431f4a0abf0 service nova] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-adadf76c-26b3-42df-892d-8a93be12216f req-56bb2333-cecd-4889-9814-c431f4a0abf0 service nova] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-adadf76c-26b3-42df-892d-8a93be12216f req-56bb2333-cecd-4889-9814-c431f4a0abf0 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] No waiting events found dispatching network-vif-plugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:26 user nova-compute[74482]: WARNING nova.compute.manager [req-adadf76c-26b3-42df-892d-8a93be12216f req-56bb2333-cecd-4889-9814-c431f4a0abf0 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received unexpected event network-vif-plugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 for instance with vm_state building and task_state spawning.
Oct 23 23:05:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:05:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Instance spawned successfully.
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-c835ad34-6dcd-49c1-a605-2a1de07e4ca0 req-19ae3dc8-6481-4785-a9e7-97e926d9f156 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received event network-vif-plugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c835ad34-6dcd-49c1-a605-2a1de07e4ca0 req-19ae3dc8-6481-4785-a9e7-97e926d9f156 service nova] Acquiring lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c835ad34-6dcd-49c1-a605-2a1de07e4ca0 req-19ae3dc8-6481-4785-a9e7-97e926d9f156 service nova] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c835ad34-6dcd-49c1-a605-2a1de07e4ca0 req-19ae3dc8-6481-4785-a9e7-97e926d9f156 service nova] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-c835ad34-6dcd-49c1-a605-2a1de07e4ca0 req-19ae3dc8-6481-4785-a9e7-97e926d9f156 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] No waiting events found dispatching network-vif-plugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:28 user nova-compute[74482]: WARNING nova.compute.manager [req-c835ad34-6dcd-49c1-a605-2a1de07e4ca0 req-19ae3dc8-6481-4785-a9e7-97e926d9f156 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received unexpected event network-vif-plugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 for instance with vm_state building and task_state spawning.
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:05:28 user nova-compute[74482]: INFO nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Took 6.47 seconds to spawn the instance on the hypervisor.
Oct 23 23:05:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:05:29 user nova-compute[74482]: INFO nova.compute.manager [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Took 8.85 seconds to build instance.
Oct 23 23:05:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ce403c3c-2993-48b4-a02d-a9c1976fbfb4 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.668s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Starting finish_revert_migration {{(pid=74482) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Start _get_guest_xml network_info=[{"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'aa063829-b117-40f4-93f2-358b33f1d156', 'attached_at': '2023-10-23T23:05:46.000000', 'detached_at': '', 'volume_id': 'a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'serial': 'a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368'}, 'disk_bus': 'virtio', 'attachment_id': '8deabedd-c1a5-49d7-bf11-3e90896b00a5', 'boot_index': None, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:05:46 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:05:46 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa063829-b117-40f4-93f2-358b33f1d156 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:05:46 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:05:46 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:05:46 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd718f61-786d-47f0-9e21-9c8e2587a646]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:05:46 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d6a2d0-a311-4835-90c3-11d8ef07646b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368] added
Oct 23 23:05:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e584163a-1a81-4f53-a11a-22e9aaa1f680]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[710e24ac-c85e-425b-a5e0-27170cc986dd]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrQcGyOU {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrQcGyOU" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a1d2bf-5b21-4d39-945c-d32b59030249]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZrQcGyOU'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c93341a-5c0f-4d4a-9973-52e7604b0d59]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e649fffe-7e44-4343-887c-cec175679a37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:46 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:46 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[10897742-5fd2-4346-b823-c3e69c47cec9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]
Oct 23 23:05:46 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.
Oct 23 23:05:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a43060e-5259-480e-b1d4-1f22051a58dc]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d672af-8a34-4bde-83a9-817c0f7ec25c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:46 user nova-compute[74482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:46 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:05:46 user nova-compute[74482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:05:46 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:05:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[78de05b3-6ee6-4efa-9842-d7d42e39808b]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:05:46 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:47 user nova-compute[74482]: INFO nova.compute.manager [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Detaching volume c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:05:47 user nova-compute[74482]: INFO nova.virt.block_device [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Attempting to driver detach volume c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e from mountpoint /dev/vdb
Oct 23 23:05:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Attempting to detach device vdb from instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:05:47 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:05:47 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:05:47 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:05:47 user nova-compute[74482]:   <serial>c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e</serial>
Oct 23 23:05:47 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:05:47 user nova-compute[74482]: </disk>
Oct 23 23:05:47 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:05:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Successfully detached device vdb from instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d from the persistent domain config.
Oct 23 23:05:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:05:47 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:05:47 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:05:47 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:05:47 user nova-compute[74482]:   <serial>c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e</serial>
Oct 23 23:05:47 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:05:47 user nova-compute[74482]: </disk>
Oct 23 23:05:47 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26261646363366166', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:05:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261646363366166', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1895303322',display_name='tempest-ServerActionsTestOtherB-server-1895303322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1895303322',id=2,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtTCYnjLWuZ5ND071jtsoNL+jCbUBIt9fx3Xpn4EVHhYK3Fa774GNC5Gw1NBdqzVTnVApUJDfyn5fEVDoKQTbN3TLPt6wiaiOSOkoESIbi/mWxf/f66vq9c/4Twd5CY7Q==',key_name='tempest-keypair-2026660343',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69039bafbadf4db8862003e2483fc973',ramdisk_id='',reservation_id='r-ejmhk03v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-598393554',owner_user_name='tempest-ServerActionsTestOtherB-598393554-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad45a40b18f4217924249b71fd4c93d',uuid=aa063829-b117-40f4-93f2-358b33f1d156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converting VIF {"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:05:48 user nova-compute[74482]:   <uuid>aa063829-b117-40f4-93f2-358b33f1d156</uuid>
Oct 23 23:05:48 user nova-compute[74482]:   <name>instance-00000002</name>
Oct 23 23:05:48 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:05:48 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:05:48 user nova-compute[74482]:   <metadata>
Oct 23 23:05:48 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:05:48 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:05:48 user nova-compute[74482]:       <nova:name>tempest-ServerActionsTestOtherB-server-1895303322</nova:name>
Oct 23 23:05:48 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:05:46</nova:creationTime>
Oct 23 23:05:48 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:05:48 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:05:48 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:05:48 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:05:48 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:05:48 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:05:48 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:05:48 user nova-compute[74482]:       <nova:owner>
Oct 23 23:05:48 user nova-compute[74482]:         <nova:user uuid="8ad45a40b18f4217924249b71fd4c93d">tempest-ServerActionsTestOtherB-598393554-project-member</nova:user>
Oct 23 23:05:48 user nova-compute[74482]:         <nova:project uuid="69039bafbadf4db8862003e2483fc973">tempest-ServerActionsTestOtherB-598393554</nova:project>
Oct 23 23:05:48 user nova-compute[74482]:       </nova:owner>
Oct 23 23:05:48 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:05:48 user nova-compute[74482]:       <nova:ports>
Oct 23 23:05:48 user nova-compute[74482]:         <nova:port uuid="26dfbe86-3706-4d55-8a27-3e7d97ffbaa3">
Oct 23 23:05:48 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 23:05:48 user nova-compute[74482]:         </nova:port>
Oct 23 23:05:48 user nova-compute[74482]:       </nova:ports>
Oct 23 23:05:48 user nova-compute[74482]:     </nova:instance>
Oct 23 23:05:48 user nova-compute[74482]:   </metadata>
Oct 23 23:05:48 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:05:48 user nova-compute[74482]:     <system>
Oct 23 23:05:48 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:05:48 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:05:48 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:05:48 user nova-compute[74482]:       <entry name="serial">aa063829-b117-40f4-93f2-358b33f1d156</entry>
Oct 23 23:05:48 user nova-compute[74482]:       <entry name="uuid">aa063829-b117-40f4-93f2-358b33f1d156</entry>
Oct 23 23:05:48 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:05:48 user nova-compute[74482]:     </system>
Oct 23 23:05:48 user nova-compute[74482]:   </sysinfo>
Oct 23 23:05:48 user nova-compute[74482]:   <os>
Oct 23 23:05:48 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:05:48 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:05:48 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:05:48 user nova-compute[74482]:   </os>
Oct 23 23:05:48 user nova-compute[74482]:   <features>
Oct 23 23:05:48 user nova-compute[74482]:     <acpi/>
Oct 23 23:05:48 user nova-compute[74482]:     <apic/>
Oct 23 23:05:48 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:05:48 user nova-compute[74482]:   </features>
Oct 23 23:05:48 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:05:48 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:05:48 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:05:48 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:05:48 user nova-compute[74482]:   </clock>
Oct 23 23:05:48 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:05:48 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:05:48 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:05:48 user nova-compute[74482]:   </cpu>
Oct 23 23:05:48 user nova-compute[74482]:   <devices>
Oct 23 23:05:48 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:05:48 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:05:48 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk"/>
Oct 23 23:05:48 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:05:48 user nova-compute[74482]:     </disk>
Oct 23 23:05:48 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:05:48 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:05:48 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:05:48 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:05:48 user nova-compute[74482]:       <serial>a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368</serial>
Oct 23 23:05:48 user nova-compute[74482]:     </disk>
Oct 23 23:05:48 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:05:48 user nova-compute[74482]:       <mac address="fa:16:3e:5f:07:d9"/>
Oct 23 23:05:48 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:05:48 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:05:48 user nova-compute[74482]:       <target dev="tap26dfbe86-37"/>
Oct 23 23:05:48 user nova-compute[74482]:     </interface>
Oct 23 23:05:48 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:05:48 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/console.log" append="off"/>
Oct 23 23:05:48 user nova-compute[74482]:     </serial>
Oct 23 23:05:48 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:05:48 user nova-compute[74482]:     <video>
Oct 23 23:05:48 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:05:48 user nova-compute[74482]:     </video>
Oct 23 23:05:48 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:05:48 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:05:48 user nova-compute[74482]:     </rng>
Oct 23 23:05:48 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:05:48 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:05:48 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:05:48 user nova-compute[74482]:     </memballoon>
Oct 23 23:05:48 user nova-compute[74482]:   </devices>
Oct 23 23:05:48 user nova-compute[74482]: </domain>
Oct 23 23:05:48 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1895303322',display_name='tempest-ServerActionsTestOtherB-server-1895303322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1895303322',id=2,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtTCYnjLWuZ5ND071jtsoNL+jCbUBIt9fx3Xpn4EVHhYK3Fa774GNC5Gw1NBdqzVTnVApUJDfyn5fEVDoKQTbN3TLPt6wiaiOSOkoESIbi/mWxf/f66vq9c/4Twd5CY7Q==',key_name='tempest-keypair-2026660343',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='69039bafbadf4db8862003e2483fc973',ramdisk_id='',reservation_id='r-ejmhk03v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-598393554',owner_user_name='tempest-ServerActionsTestOtherB-598393554-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad45a40b18f4217924249b71fd4c93d',uuid=aa063829-b117-40f4-93f2-358b33f1d156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converting VIF {"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG os_vif [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '555976a0-e423-5268-b7e5-36fd51a4a60e', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26dfbe86-37, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26dfbe86-37, col_values=(('qos', UUID('5bda8613-46f5-4352-b760-60b6807e8e4b')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26dfbe86-37, col_values=(('external_ids', {'iface-id': '26dfbe86-3706-4d55-8a27-3e7d97ffbaa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:07:d9', 'vm-uuid': 'aa063829-b117-40f4-93f2-358b33f1d156'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:48 user nova-compute[74482]: INFO os_vif [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37')
Oct 23 23:05:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:05:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-76f3e7b3-3ad4-4f31-a329-eb7cff9ad209 req-2c3b96de-a6fb-49a8-9ab7-e8d27e1fe59f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-76f3e7b3-3ad4-4f31-a329-eb7cff9ad209 req-2c3b96de-a6fb-49a8-9ab7-e8d27e1fe59f service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-76f3e7b3-3ad4-4f31-a329-eb7cff9ad209 req-2c3b96de-a6fb-49a8-9ab7-e8d27e1fe59f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-76f3e7b3-3ad4-4f31-a329-eb7cff9ad209 req-2c3b96de-a6fb-49a8-9ab7-e8d27e1fe59f service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-76f3e7b3-3ad4-4f31-a329-eb7cff9ad209 req-2c3b96de-a6fb-49a8-9ab7-e8d27e1fe59f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:50 user nova-compute[74482]: WARNING nova.compute.manager [req-76f3e7b3-3ad4-4f31-a329-eb7cff9ad209 req-2c3b96de-a6fb-49a8-9ab7-e8d27e1fe59f service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state resized and task_state resize_reverting.
Oct 23 23:05:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-cafe08e1-2341-4d40-8c1f-11601280bae8 req-d30b5245-a8f1-4165-85f5-a50bcfb0f1ab service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cafe08e1-2341-4d40-8c1f-11601280bae8 req-d30b5245-a8f1-4165-85f5-a50bcfb0f1ab service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cafe08e1-2341-4d40-8c1f-11601280bae8 req-d30b5245-a8f1-4165-85f5-a50bcfb0f1ab service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cafe08e1-2341-4d40-8c1f-11601280bae8 req-d30b5245-a8f1-4165-85f5-a50bcfb0f1ab service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-cafe08e1-2341-4d40-8c1f-11601280bae8 req-d30b5245-a8f1-4165-85f5-a50bcfb0f1ab service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:52 user nova-compute[74482]: WARNING nova.compute.manager [req-cafe08e1-2341-4d40-8c1f-11601280bae8 req-d30b5245-a8f1-4165-85f5-a50bcfb0f1ab service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state resized and task_state resize_reverting.
Oct 23 23:05:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:05:52 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance running successfully.
Oct 23 23:05:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] finish_revert_migration finished successfully. {{(pid=74482) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 23 23:05:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:52 user nova-compute[74482]: INFO nova.compute.manager [None req-d7ced70d-96d5-401d-8691-c84ce595fcdb tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance to original state: 'active'
Oct 23 23:05:52 user nova-compute[74482]: INFO nova.compute.manager [None req-72677b73-9981-40f4-b77c-209740dcbfeb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Unrescuing
Oct 23 23:05:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-72677b73-9981-40f4-b77c-209740dcbfeb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-72677b73-9981-40f4-b77c-209740dcbfeb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquired lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:52 user nova-compute[74482]: DEBUG nova.network.neutron [None req-72677b73-9981-40f4-b77c-209740dcbfeb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:05:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:53 user nova-compute[74482]: INFO nova.compute.manager [None req-bf4513da-bcee-4e9b-a96d-a62e4b2aec1a tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Unrescuing
Oct 23 23:05:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf4513da-bcee-4e9b-a96d-a62e4b2aec1a tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:05:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf4513da-bcee-4e9b-a96d-a62e4b2aec1a tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquired lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:05:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf4513da-bcee-4e9b-a96d-a62e4b2aec1a tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:05:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-72677b73-9981-40f4-b77c-209740dcbfeb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updating instance_info_cache with network_info: [{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-72677b73-9981-40f4-b77c-209740dcbfeb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Releasing lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:53 user nova-compute[74482]: DEBUG nova.objects.instance [None req-72677b73-9981-40f4-b77c-209740dcbfeb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'flavor' on Instance uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:05:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf4513da-bcee-4e9b-a96d-a62e4b2aec1a tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updating instance_info_cache with network_info: [{"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf4513da-bcee-4e9b-a96d-a62e4b2aec1a tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Releasing lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG nova.objects.instance [None req-bf4513da-bcee-4e9b-a96d-a62e4b2aec1a tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'flavor' on Instance uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:54 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Instance destroyed successfully.
Oct 23 23:05:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-bf09847a-54b2-4102-934e-254004ad7ab6 req-702e5bff-12d8-4a8d-91b7-108469583863 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-unplugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bf09847a-54b2-4102-934e-254004ad7ab6 req-702e5bff-12d8-4a8d-91b7-108469583863 service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bf09847a-54b2-4102-934e-254004ad7ab6 req-702e5bff-12d8-4a8d-91b7-108469583863 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bf09847a-54b2-4102-934e-254004ad7ab6 req-702e5bff-12d8-4a8d-91b7-108469583863 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-bf09847a-54b2-4102-934e-254004ad7ab6 req-702e5bff-12d8-4a8d-91b7-108469583863 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-unplugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:54 user nova-compute[74482]: WARNING nova.compute.manager [req-bf09847a-54b2-4102-934e-254004ad7ab6 req-702e5bff-12d8-4a8d-91b7-108469583863 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-unplugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:05:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:55 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Instance destroyed successfully.
Oct 23 23:05:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-39e27e8d-80ba-441e-bee0-21f0ab23c282 req-4cdf2b6d-86ce-4677-b0df-68d3423f63f9 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-39e27e8d-80ba-441e-bee0-21f0ab23c282 req-4cdf2b6d-86ce-4677-b0df-68d3423f63f9 service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-39e27e8d-80ba-441e-bee0-21f0ab23c282 req-4cdf2b6d-86ce-4677-b0df-68d3423f63f9 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-39e27e8d-80ba-441e-bee0-21f0ab23c282 req-4cdf2b6d-86ce-4677-b0df-68d3423f63f9 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-39e27e8d-80ba-441e-bee0-21f0ab23c282 req-4cdf2b6d-86ce-4677-b0df-68d3423f63f9 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:56 user nova-compute[74482]: WARNING nova.compute.manager [req-39e27e8d-80ba-441e-bee0-21f0ab23c282 req-4cdf2b6d-86ce-4677-b0df-68d3423f63f9 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:05:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-cda3a742-4e2b-4b5c-a7b8-1d9d7a5433a2 req-22787f0e-16f7-4222-91dc-e96f5f01768e service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cda3a742-4e2b-4b5c-a7b8-1d9d7a5433a2 req-22787f0e-16f7-4222-91dc-e96f5f01768e service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cda3a742-4e2b-4b5c-a7b8-1d9d7a5433a2 req-22787f0e-16f7-4222-91dc-e96f5f01768e service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cda3a742-4e2b-4b5c-a7b8-1d9d7a5433a2 req-22787f0e-16f7-4222-91dc-e96f5f01768e service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-cda3a742-4e2b-4b5c-a7b8-1d9d7a5433a2 req-22787f0e-16f7-4222-91dc-e96f5f01768e service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:58 user nova-compute[74482]: WARNING nova.compute.manager [req-cda3a742-4e2b-4b5c-a7b8-1d9d7a5433a2 req-22787f0e-16f7-4222-91dc-e96f5f01768e service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:05:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:05:59 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Creating image(s)
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-ddadec20-10b5-4b48-a800-8f7069120e08 req-c9875d61-2c39-44bb-973a-1d059063fddc service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-unplugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ddadec20-10b5-4b48-a800-8f7069120e08 req-c9875d61-2c39-44bb-973a-1d059063fddc service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ddadec20-10b5-4b48-a800-8f7069120e08 req-c9875d61-2c39-44bb-973a-1d059063fddc service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ddadec20-10b5-4b48-a800-8f7069120e08 req-c9875d61-2c39-44bb-973a-1d059063fddc service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-ddadec20-10b5-4b48-a800-8f7069120e08 req-c9875d61-2c39-44bb-973a-1d059063fddc service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-unplugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:05:59 user nova-compute[74482]: WARNING nova.compute.manager [req-ddadec20-10b5-4b48-a800-8f7069120e08 req-c9875d61-2c39-44bb-973a-1d059063fddc service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-unplugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.216s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:05:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.274s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk 1073741824" returned: 0 in 0.052s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.317s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Cannot resize image /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Ensure instance console log exists: /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Start _get_guest_xml network_info=[{"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThXYdgFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a91897d-e83c-4396-8584-c8ff4fcfc553', 'attached_at': '', 'detached_at': '', 'volume_id': '926911cd-cb13-410d-80a2-b33f3d262b62', 'serial': '926911cd-cb13-410d-80a2-b33f3d262b62'}, 'disk_bus': 'virtio', 'attachment_id': '9fa3cbb0-a327-4b8e-820d-fdb85ec47934', 'boot_index': None, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:06:00 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 23:06:00 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.objects.instance [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a91897d-e83c-4396-8584-c8ff4fcfc553 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThXYdgFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:06:00 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 23:06:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:06:00 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 23:06:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:06:00 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-72677b73-9981-40f4-b77c-209740dcbfeb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c9b5c-97b9-43c6-af37-ee5c245a43f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:06:00 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a77663c-689b-4890-9a95-19297788dd49 req-08b41f2b-1867-4a30-9055-9c6084385a3c service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a77663c-689b-4890-9a95-19297788dd49 req-08b41f2b-1867-4a30-9055-9c6084385a3c service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a77663c-689b-4890-9a95-19297788dd49 req-08b41f2b-1867-4a30-9055-9c6084385a3c service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a77663c-689b-4890-9a95-19297788dd49 req-08b41f2b-1867-4a30-9055-9c6084385a3c service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a77663c-689b-4890-9a95-19297788dd49 req-08b41f2b-1867-4a30-9055-9c6084385a3c service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:01 user nova-compute[74482]: WARNING nova.compute.manager [req-1a77663c-689b-4890-9a95-19297788dd49 req-08b41f2b-1867-4a30-9055-9c6084385a3c service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.048s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[333232f3-13df-4193-b165-b91fd43d35e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62] added
Oct 23 23:06:01 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a908278a-bc9d-40ef-855c-a22ddf041189]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bf4513da-bcee-4e9b-a96d-a62e4b2aec1a tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6409bfc1-c566-4de2-ae11-6adaf09fada4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThXYdgFf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThXYdgFf" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2e5483-cfca-407b-adde-49148c35c74d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ThXYdgFf'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80d0881-81c9-4498-9383-8e88ecb4884f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afc28e7-18ad-4def-950e-19896d784cf0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[940cb006-f290-4dc8-bceb-e556e2fdbf4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260]
Oct 23 23:06:01 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260] successful.
Oct 23 23:06:01 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2d3cd9-83c4-4b53-aaef-e7edb11248cc]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[194e7878-139b-4993-bb0e-d90a1876de88]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:01 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[012a2fbd-12c0-47df-9e96-3d52456dc0f6]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThXYdgFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:01 user nova-compute[74482]: WARNING nova.compute.manager [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state active and task_state None.
Oct 23 23:06:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:01 user nova-compute[74482]: WARNING nova.compute.manager [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state active and task_state None.
Oct 23 23:06:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:01 user nova-compute[74482]: WARNING nova.compute.manager [req-563fae93-443a-429d-8a2b-c9408ffedc36 req-0b4be998-56b5-49be-b43a-9e8b1ac1478d service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state active and task_state None.
Oct 23 23:06:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26432623039663266', 'path': '/dev/sde'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432623039663266', 'path': '/dev/sde'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1405955470',display_name='tempest-ServerActionsTestOtherA-server-466596655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1405955470',id=13,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+kFDD4wwJWW/1hObOOzjmoSpoVE08++Rl7M3rZ7hasNILrz2Hts0rh2BR+TeMo8ArCwaM5O7vBiIcCD76Cv0A5UMS3pbhQxU/biWWpIfcmTYASw0GYH12Hz9/vT8pENw==',key_name='tempest-keypair-25770726',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-wps4jnhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=2a91897d-e83c-4396-8584-c8ff4fcfc553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:06:02 user nova-compute[74482]:   <uuid>2a91897d-e83c-4396-8584-c8ff4fcfc553</uuid>
Oct 23 23:06:02 user nova-compute[74482]:   <name>instance-0000000d</name>
Oct 23 23:06:02 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:06:02 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:06:02 user nova-compute[74482]:   <metadata>
Oct 23 23:06:02 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:06:02 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:06:02 user nova-compute[74482]:       <nova:name>tempest-ServerActionsTestOtherA-server-466596655</nova:name>
Oct 23 23:06:02 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:06:00</nova:creationTime>
Oct 23 23:06:02 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:06:02 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:06:02 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:06:02 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:06:02 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:06:02 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:06:02 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:06:02 user nova-compute[74482]:       <nova:owner>
Oct 23 23:06:02 user nova-compute[74482]:         <nova:user uuid="a6e62933fe47479baf3029e44d3b8759">tempest-ServerActionsTestOtherA-1928343369-project-member</nova:user>
Oct 23 23:06:02 user nova-compute[74482]:         <nova:project uuid="7418b41ef984478daf12ce3a2c72c3c6">tempest-ServerActionsTestOtherA-1928343369</nova:project>
Oct 23 23:06:02 user nova-compute[74482]:       </nova:owner>
Oct 23 23:06:02 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:06:02 user nova-compute[74482]:       <nova:ports>
Oct 23 23:06:02 user nova-compute[74482]:         <nova:port uuid="f4d3d364-6576-469e-b136-32509ea1bef0">
Oct 23 23:06:02 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 23:06:02 user nova-compute[74482]:         </nova:port>
Oct 23 23:06:02 user nova-compute[74482]:       </nova:ports>
Oct 23 23:06:02 user nova-compute[74482]:     </nova:instance>
Oct 23 23:06:02 user nova-compute[74482]:   </metadata>
Oct 23 23:06:02 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:06:02 user nova-compute[74482]:     <system>
Oct 23 23:06:02 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:06:02 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:06:02 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:06:02 user nova-compute[74482]:       <entry name="serial">2a91897d-e83c-4396-8584-c8ff4fcfc553</entry>
Oct 23 23:06:02 user nova-compute[74482]:       <entry name="uuid">2a91897d-e83c-4396-8584-c8ff4fcfc553</entry>
Oct 23 23:06:02 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:06:02 user nova-compute[74482]:     </system>
Oct 23 23:06:02 user nova-compute[74482]:   </sysinfo>
Oct 23 23:06:02 user nova-compute[74482]:   <os>
Oct 23 23:06:02 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:06:02 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:06:02 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:06:02 user nova-compute[74482]:   </os>
Oct 23 23:06:02 user nova-compute[74482]:   <features>
Oct 23 23:06:02 user nova-compute[74482]:     <acpi/>
Oct 23 23:06:02 user nova-compute[74482]:     <apic/>
Oct 23 23:06:02 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:06:02 user nova-compute[74482]:   </features>
Oct 23 23:06:02 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:06:02 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:06:02 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:06:02 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:06:02 user nova-compute[74482]:   </clock>
Oct 23 23:06:02 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:06:02 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:06:02 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:06:02 user nova-compute[74482]:   </cpu>
Oct 23 23:06:02 user nova-compute[74482]:   <devices>
Oct 23 23:06:02 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:06:02 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:06:02 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk"/>
Oct 23 23:06:02 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:06:02 user nova-compute[74482]:     </disk>
Oct 23 23:06:02 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:06:02 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:06:02 user nova-compute[74482]:       <source dev="/dev/sde"/>
Oct 23 23:06:02 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:06:02 user nova-compute[74482]:       <serial>926911cd-cb13-410d-80a2-b33f3d262b62</serial>
Oct 23 23:06:02 user nova-compute[74482]:     </disk>
Oct 23 23:06:02 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:06:02 user nova-compute[74482]:       <mac address="fa:16:3e:68:49:59"/>
Oct 23 23:06:02 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:06:02 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:06:02 user nova-compute[74482]:       <target dev="tapf4d3d364-65"/>
Oct 23 23:06:02 user nova-compute[74482]:     </interface>
Oct 23 23:06:02 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:06:02 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/console.log" append="off"/>
Oct 23 23:06:02 user nova-compute[74482]:     </serial>
Oct 23 23:06:02 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:06:02 user nova-compute[74482]:     <video>
Oct 23 23:06:02 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:06:02 user nova-compute[74482]:     </video>
Oct 23 23:06:02 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:06:02 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:06:02 user nova-compute[74482]:     </rng>
Oct 23 23:06:02 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:06:02 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:06:02 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:06:02 user nova-compute[74482]:     </memballoon>
Oct 23 23:06:02 user nova-compute[74482]:   </devices>
Oct 23 23:06:02 user nova-compute[74482]: </domain>
Oct 23 23:06:02 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1405955470',display_name='tempest-ServerActionsTestOtherA-server-466596655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1405955470',id=13,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+kFDD4wwJWW/1hObOOzjmoSpoVE08++Rl7M3rZ7hasNILrz2Hts0rh2BR+TeMo8ArCwaM5O7vBiIcCD76Cv0A5UMS3pbhQxU/biWWpIfcmTYASw0GYH12Hz9/vT8pENw==',key_name='tempest-keypair-25770726',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:03:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-wps4jnhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=2a91897d-e83c-4396-8584-c8ff4fcfc553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG os_vif [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e21342e-1532-55ae-94ab-102746c3a7a8', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4d3d364-65, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4d3d364-65, col_values=(('qos', UUID('fb30e839-20a1-470b-8705-43b4e6b71c44')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4d3d364-65, col_values=(('external_ids', {'iface-id': 'f4d3d364-6576-469e-b136-32509ea1bef0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:49:59', 'vm-uuid': '2a91897d-e83c-4396-8584-c8ff4fcfc553'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:02 user nova-compute[74482]: INFO os_vif [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65')
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:06:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No VIF found with MAC fa:16:3e:68:49:59, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:06:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:06:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:06:04 user nova-compute[74482]: INFO nova.compute.claims [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Claim successful on node user
Oct 23 23:06:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-b0afe153-d748-420b-bd28-b7d6f236e6b9 req-14b75d53-eb59-485d-88db-e836fe06d659 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-changed-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-b0afe153-d748-420b-bd28-b7d6f236e6b9 req-14b75d53-eb59-485d-88db-e836fe06d659 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Refreshing instance network info cache due to event network-changed-d1739e04-cfa4-4e83-bc72-4f508cbfd0df. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b0afe153-d748-420b-bd28-b7d6f236e6b9 req-14b75d53-eb59-485d-88db-e836fe06d659 service nova] Acquiring lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b0afe153-d748-420b-bd28-b7d6f236e6b9 req-14b75d53-eb59-485d-88db-e836fe06d659 service nova] Acquired lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.network.neutron [req-b0afe153-d748-420b-bd28-b7d6f236e6b9 req-14b75d53-eb59-485d-88db-e836fe06d659 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Refreshing network info cache for port d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.network.neutron [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:06:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.policy [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f2f6cc277224a04a377fc0bfc3b5021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b95877b43e4d458fd124f0ae506aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:06:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Creating image(s)
Oct 23 23:06:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "/opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "/opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "/opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "interface-777f18b7-f03c-449f-ad4b-50ebeb67a38b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "interface-777f18b7-f03c-449f-ad4b-50ebeb67a38b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lazy-loading 'flavor' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.295s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.network.neutron [req-b0afe153-d748-420b-bd28-b7d6f236e6b9 req-14b75d53-eb59-485d-88db-e836fe06d659 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updated VIF entry in instance network info cache for port d1739e04-cfa4-4e83-bc72-4f508cbfd0df. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.network.neutron [req-b0afe153-d748-420b-bd28-b7d6f236e6b9 req-14b75d53-eb59-485d-88db-e836fe06d659 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating instance_info_cache with network_info: [{"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b0afe153-d748-420b-bd28-b7d6f236e6b9 req-14b75d53-eb59-485d-88db-e836fe06d659 service nova] Releasing lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.219s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk 1073741824" returned: 0 in 0.065s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lazy-loading 'pci_requests' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.objects.base [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Object Instance<777f18b7-f03c-449f-ad4b-50ebeb67a38b> lazy-loaded attributes: flavor,pci_requests {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.network.neutron [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Successfully created port: 4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.policy [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a0cc3a0ea394dcf85a7ede8e400faf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8b28ec62224967ab9679d4761e7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.239s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Cannot resize image /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Ensure instance console log exists: /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-6a34e7ca-694a-48d3-bc20-49742ce6e539 req-9d6bfab6-66e2-43af-9aaa-c7fe2b195458 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6a34e7ca-694a-48d3-bc20-49742ce6e539 req-9d6bfab6-66e2-43af-9aaa-c7fe2b195458 service nova] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6a34e7ca-694a-48d3-bc20-49742ce6e539 req-9d6bfab6-66e2-43af-9aaa-c7fe2b195458 service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6a34e7ca-694a-48d3-bc20-49742ce6e539 req-9d6bfab6-66e2-43af-9aaa-c7fe2b195458 service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-6a34e7ca-694a-48d3-bc20-49742ce6e539 req-9d6bfab6-66e2-43af-9aaa-c7fe2b195458 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] No waiting events found dispatching network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:06 user nova-compute[74482]: WARNING nova.compute.manager [req-6a34e7ca-694a-48d3-bc20-49742ce6e539 req-9d6bfab6-66e2-43af-9aaa-c7fe2b195458 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received unexpected event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 for instance with vm_state active and task_state rebuild_spawning.
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:06:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Instance spawned successfully.
Oct 23 23:06:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Successfully created port: 9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74482) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-71f65b82-efa8-4d94-85fa-4fc035deca80 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.125s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Successfully updated port: 9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquired lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-b3da106c-23bf-446a-bfa4-17549eeadbd5 req-43c61582-87c6-45d0-93a1-4494da8e64cb service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-changed-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-b3da106c-23bf-446a-bfa4-17549eeadbd5 req-43c61582-87c6-45d0-93a1-4494da8e64cb service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Refreshing instance network info cache due to event network-changed-9c4c4463-b0e7-4bab-8353-6518fa71af9b. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b3da106c-23bf-446a-bfa4-17549eeadbd5 req-43c61582-87c6-45d0-93a1-4494da8e64cb service nova] Acquiring lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Successfully updated port: 4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "refresh_cache-1718ea62-105b-44ac-80f6-587224314449" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquired lock "refresh_cache-1718ea62-105b-44ac-80f6-587224314449" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d is timed out.
Oct 23 23:06:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Successfully detached device vdb from instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d from the live domain config.
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DFqUOnra', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:06:08 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be12d9-980f-4424-8631-88f3200c569a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:06:08 user nova-compute[74482]: No targets found.
Oct 23 23:06:08 user nova-compute[74482]: iSNS:
Oct 23 23:06:08 user nova-compute[74482]: No targets found.
Oct 23 23:06:08 user nova-compute[74482]: STATIC:
Oct 23 23:06:08 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e
Oct 23 23:06:08 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:06:08 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:06:08 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:06:08 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:06:08 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:06:08 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62
Oct 23 23:06:08 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:06:08 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:06:08 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:06:08 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:06:08 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:06:08 user nova-compute[74482]: FIRMWARE:
Oct 23 23:06:08 user nova-compute[74482]: No targets found.
Oct 23 23:06:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:06:08 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:06:08 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c75645-1792-417f-a891-d5a98ff9f66e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c317c446-dbbc-4d92-9b07-d86e1cae1db0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:06:08 user nova-compute[74482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:08 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:08 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e (non-flash)
Oct 23 23:06:08 user nova-compute[74482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:08 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:08 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c436710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e'): ({'sdd'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Removing single pathed devices sdd {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[206ed70f-06c8-4ae1-b0b9-5f2bb6175583]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.035s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[46598d94-c10b-4d0e-a597-0c64f1db323c]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Flushing IO for device /dev/sdd {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[431e67d5-552f-48fc-83c0-bdefdcaeacd0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.068s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d73479-b412-4fe9-95bf-9c54aa4783fb]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40b5d6e-06f3-4c11-97cb-0414fdcc71e3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Updating instance_info_cache with network_info: [{"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6166c4dc-54a2-4f4a-84ea-66981488a6de]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e, portal: 172.16.0.220,3260]
Oct 23 23:06:08 user nova-compute[74482]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e, portal: 172.16.0.220,3260] successful.
Oct 23 23:06:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Releasing lock "refresh_cache-1718ea62-105b-44ac-80f6-587224314449" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Instance network_info: |[{"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Start _get_guest_xml network_info=[{"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:06:08 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:06:08 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c70ebc4e-15df-4d2c-8e4a-b0ace8e49a5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2bc44b-231d-4ed8-af6c-17254c324d9a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] <== disconnect_volume: return (442ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1548022627',display_name='tempest-VolumesAdminNegativeTest-server-1548022627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1548022627',id=17,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNu1SU0w1gzobQN6TU32JuWzmctnwzQt4Sqf/HRd8Y31ohePul8TSf3/FdwfClpUSReVOHK/kMrRwYFrFvLC3TKSMy1O4Mu+hrsQQTzAuK073EjPYkMkW/gdKgeH6ioBsQ==',key_name='tempest-keypair-512399428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98b95877b43e4d458fd124f0ae506aaf',ramdisk_id='',reservation_id='r-cylr31on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1781155714',owner_user_name='tempest-VolumesAdminNegativeTest-1781155714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f2f6cc277224a04a377fc0bfc3b5021',uuid=1718ea62-105b-44ac-80f6-587224314449,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converting VIF {"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:12:4f,bridge_name='br-int',has_traffic_filtering=True,id=4c31b56e-df70-475c-a0fc-7c5c1be07e26,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31b56e-df') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.objects.instance [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lazy-loading 'pci_devices' on Instance uuid 1718ea62-105b-44ac-80f6-587224314449 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:06:08 user nova-compute[74482]:   <uuid>1718ea62-105b-44ac-80f6-587224314449</uuid>
Oct 23 23:06:08 user nova-compute[74482]:   <name>instance-00000011</name>
Oct 23 23:06:08 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:06:08 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:06:08 user nova-compute[74482]:   <metadata>
Oct 23 23:06:08 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:06:08 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:06:08 user nova-compute[74482]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1548022627</nova:name>
Oct 23 23:06:08 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:06:08</nova:creationTime>
Oct 23 23:06:08 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:06:08 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:06:08 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:06:08 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:06:08 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:06:08 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:06:08 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:06:08 user nova-compute[74482]:       <nova:owner>
Oct 23 23:06:08 user nova-compute[74482]:         <nova:user uuid="4f2f6cc277224a04a377fc0bfc3b5021">tempest-VolumesAdminNegativeTest-1781155714-project-member</nova:user>
Oct 23 23:06:08 user nova-compute[74482]:         <nova:project uuid="98b95877b43e4d458fd124f0ae506aaf">tempest-VolumesAdminNegativeTest-1781155714</nova:project>
Oct 23 23:06:08 user nova-compute[74482]:       </nova:owner>
Oct 23 23:06:08 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:06:08 user nova-compute[74482]:       <nova:ports>
Oct 23 23:06:08 user nova-compute[74482]:         <nova:port uuid="4c31b56e-df70-475c-a0fc-7c5c1be07e26">
Oct 23 23:06:08 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 23:06:08 user nova-compute[74482]:         </nova:port>
Oct 23 23:06:08 user nova-compute[74482]:       </nova:ports>
Oct 23 23:06:08 user nova-compute[74482]:     </nova:instance>
Oct 23 23:06:08 user nova-compute[74482]:   </metadata>
Oct 23 23:06:08 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:06:08 user nova-compute[74482]:     <system>
Oct 23 23:06:08 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:06:08 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:06:08 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:06:08 user nova-compute[74482]:       <entry name="serial">1718ea62-105b-44ac-80f6-587224314449</entry>
Oct 23 23:06:08 user nova-compute[74482]:       <entry name="uuid">1718ea62-105b-44ac-80f6-587224314449</entry>
Oct 23 23:06:08 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:06:08 user nova-compute[74482]:     </system>
Oct 23 23:06:08 user nova-compute[74482]:   </sysinfo>
Oct 23 23:06:08 user nova-compute[74482]:   <os>
Oct 23 23:06:08 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:06:08 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:06:08 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:06:08 user nova-compute[74482]:   </os>
Oct 23 23:06:08 user nova-compute[74482]:   <features>
Oct 23 23:06:08 user nova-compute[74482]:     <acpi/>
Oct 23 23:06:08 user nova-compute[74482]:     <apic/>
Oct 23 23:06:08 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:06:08 user nova-compute[74482]:   </features>
Oct 23 23:06:08 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:06:08 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:06:08 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:06:08 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:06:08 user nova-compute[74482]:   </clock>
Oct 23 23:06:08 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:06:08 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:06:08 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:06:08 user nova-compute[74482]:   </cpu>
Oct 23 23:06:08 user nova-compute[74482]:   <devices>
Oct 23 23:06:08 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:06:08 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:06:08 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk"/>
Oct 23 23:06:08 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:06:08 user nova-compute[74482]:     </disk>
Oct 23 23:06:08 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:06:08 user nova-compute[74482]:       <mac address="fa:16:3e:37:12:4f"/>
Oct 23 23:06:08 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:06:08 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:06:08 user nova-compute[74482]:       <target dev="tap4c31b56e-df"/>
Oct 23 23:06:08 user nova-compute[74482]:     </interface>
Oct 23 23:06:08 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:06:08 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/console.log" append="off"/>
Oct 23 23:06:08 user nova-compute[74482]:     </serial>
Oct 23 23:06:08 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:06:08 user nova-compute[74482]:     <video>
Oct 23 23:06:08 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:06:08 user nova-compute[74482]:     </video>
Oct 23 23:06:08 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:06:08 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:06:08 user nova-compute[74482]:     </rng>
Oct 23 23:06:08 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:06:08 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:06:08 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:06:08 user nova-compute[74482]:     </memballoon>
Oct 23 23:06:08 user nova-compute[74482]:   </devices>
Oct 23 23:06:08 user nova-compute[74482]: </domain>
Oct 23 23:06:08 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1548022627',display_name='tempest-VolumesAdminNegativeTest-server-1548022627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1548022627',id=17,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNu1SU0w1gzobQN6TU32JuWzmctnwzQt4Sqf/HRd8Y31ohePul8TSf3/FdwfClpUSReVOHK/kMrRwYFrFvLC3TKSMy1O4Mu+hrsQQTzAuK073EjPYkMkW/gdKgeH6ioBsQ==',key_name='tempest-keypair-512399428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98b95877b43e4d458fd124f0ae506aaf',ramdisk_id='',reservation_id='r-cylr31on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1781155714',owner_user_name='tempest-VolumesAdminNegativeTest-1781155714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f2f6cc277224a04a377fc0bfc3b5021',uuid=1718ea62-105b-44ac-80f6-587224314449,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converting VIF {"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:12:4f,bridge_name='br-int',has_traffic_filtering=True,id=4c31b56e-df70-475c-a0fc-7c5c1be07e26,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31b56e-df') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_vif [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:12:4f,bridge_name='br-int',has_traffic_filtering=True,id=4c31b56e-df70-475c-a0fc-7c5c1be07e26,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31b56e-df') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '464096f2-d93c-5a8c-b5fb-933b0663f531', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c31b56e-df, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c31b56e-df, col_values=(('qos', UUID('4ede0b1b-bc01-46cd-b64f-c92225918c45')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c31b56e-df, col_values=(('external_ids', {'iface-id': '4c31b56e-df70-475c-a0fc-7c5c1be07e26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:12:4f', 'vm-uuid': '1718ea62-105b-44ac-80f6-587224314449'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: INFO os_vif [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:12:4f,bridge_name='br-int',has_traffic_filtering=True,id=4c31b56e-df70-475c-a0fc-7c5c1be07e26,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31b56e-df')
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating instance_info_cache with network_info: [{"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Releasing lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b3da106c-23bf-446a-bfa4-17549eeadbd5 req-43c61582-87c6-45d0-93a1-4494da8e64cb service nova] Acquired lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.neutron [req-b3da106c-23bf-446a-bfa4-17549eeadbd5 req-43c61582-87c6-45d0-93a1-4494da8e64cb service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Refreshing network info cache for port 9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1736457799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1736457799',id=14,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qsXrQessntnV1ggy4TtGhnjE2kFMAm3s1+DIHjlcVYXHL0gF6xHKL7xIdhkF0DlXvm8j+JS6shzfqKN69YtxRTbxo+XLeEdMDeMHhyLn/eHYes9kQEt1YgJ6oZynFVA==',key_name='tempest-keypair-1108949033',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d8b28ec62224967ab9679d4761e7e67',ramdisk_id='',reservation_id='r-evruxiqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2107078344',owner_user_name='tempest-TaggedAttachmentsTest-2107078344-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0cc3a0ea394dcf85a7ede8e400faf5',uuid=777f18b7-f03c-449f-ad4b-50ebeb67a38b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converting VIF {"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG os_vif [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fb6bb08-3c1a-5977-a449-ffd11eadc883', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c4c4463-b0, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c4c4463-b0, col_values=(('qos', UUID('15c38db3-3fb2-4bf2-a2a2-e27b8427fdda')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c4c4463-b0, col_values=(('external_ids', {'iface-id': '9c4c4463-b0e7-4bab-8353-6518fa71af9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:f1:3e', 'vm-uuid': '777f18b7-f03c-449f-ad4b-50ebeb67a38b'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] No VIF found with MAC fa:16:3e:37:12:4f, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:09 user nova-compute[74482]: INFO os_vif [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0')
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1736457799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1736457799',id=14,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qsXrQessntnV1ggy4TtGhnjE2kFMAm3s1+DIHjlcVYXHL0gF6xHKL7xIdhkF0DlXvm8j+JS6shzfqKN69YtxRTbxo+XLeEdMDeMHhyLn/eHYes9kQEt1YgJ6oZynFVA==',key_name='tempest-keypair-1108949033',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2d8b28ec62224967ab9679d4761e7e67',ramdisk_id='',reservation_id='r-evruxiqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2107078344',owner_user_name='tempest-TaggedAttachmentsTest-2107078344-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0cc3a0ea394dcf85a7ede8e400faf5',uuid=777f18b7-f03c-449f-ad4b-50ebeb67a38b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converting VIF {"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] attach device xml: <interface type="ethernet">
Oct 23 23:06:09 user nova-compute[74482]:   <mac address="fa:16:3e:9e:f1:3e"/>
Oct 23 23:06:09 user nova-compute[74482]:   <model type="virtio"/>
Oct 23 23:06:09 user nova-compute[74482]:   <mtu size="1442"/>
Oct 23 23:06:09 user nova-compute[74482]:   <target dev="tap9c4c4463-b0"/>
Oct 23 23:06:09 user nova-compute[74482]: </interface>
Oct 23 23:06:09 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] No waiting events found dispatching network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:09 user nova-compute[74482]: WARNING nova.compute.manager [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received unexpected event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 for instance with vm_state active and task_state None.
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received event network-changed-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Refreshing instance network info cache due to event network-changed-4c31b56e-df70-475c-a0fc-7c5c1be07e26. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] Acquiring lock "refresh_cache-1718ea62-105b-44ac-80f6-587224314449" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] Acquired lock "refresh_cache-1718ea62-105b-44ac-80f6-587224314449" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Refreshing network info cache for port 4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-b3da106c-23bf-446a-bfa4-17549eeadbd5 req-43c61582-87c6-45d0-93a1-4494da8e64cb service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updated VIF entry in instance network info cache for port 9c4c4463-b0e7-4bab-8353-6518fa71af9b. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-b3da106c-23bf-446a-bfa4-17549eeadbd5 req-43c61582-87c6-45d0-93a1-4494da8e64cb service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating instance_info_cache with network_info: [{"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b3da106c-23bf-446a-bfa4-17549eeadbd5 req-43c61582-87c6-45d0-93a1-4494da8e64cb service nova] Releasing lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Updated VIF entry in instance network info cache for port 4c31b56e-df70-475c-a0fc-7c5c1be07e26. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Updating instance_info_cache with network_info: [{"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fd08f38d-dc64-4a2a-917e-3913a5b2b875 req-98116cab-4c0d-40a2-a227-c0d25550cc4e service nova] Releasing lock "refresh_cache-1718ea62-105b-44ac-80f6-587224314449" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'flavor' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] No BDM found with device name hda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] No VIF found with MAC fa:16:3e:f4:d5:ac, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:06:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5075fae-61dd-4548-9a58-44cef47b3892 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.313s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:06:10 user nova-compute[74482]:   <nova:package version="0.0.0"/>
Oct 23 23:06:10 user nova-compute[74482]:   <nova:name>tempest-device-tagging-server-1736457799</nova:name>
Oct 23 23:06:10 user nova-compute[74482]:   <nova:creationTime>2023-10-23 23:06:10</nova:creationTime>
Oct 23 23:06:10 user nova-compute[74482]:   <nova:flavor name="m1.tiny">
Oct 23 23:06:10 user nova-compute[74482]:     <nova:memory>512</nova:memory>
Oct 23 23:06:10 user nova-compute[74482]:     <nova:disk>1</nova:disk>
Oct 23 23:06:10 user nova-compute[74482]:     <nova:swap>0</nova:swap>
Oct 23 23:06:10 user nova-compute[74482]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:06:10 user nova-compute[74482]:     <nova:vcpus>1</nova:vcpus>
Oct 23 23:06:10 user nova-compute[74482]:   </nova:flavor>
Oct 23 23:06:10 user nova-compute[74482]:   <nova:owner>
Oct 23 23:06:10 user nova-compute[74482]:     <nova:user uuid="3a0cc3a0ea394dcf85a7ede8e400faf5">tempest-TaggedAttachmentsTest-2107078344-project-member</nova:user>
Oct 23 23:06:10 user nova-compute[74482]:     <nova:project uuid="2d8b28ec62224967ab9679d4761e7e67">tempest-TaggedAttachmentsTest-2107078344</nova:project>
Oct 23 23:06:10 user nova-compute[74482]:   </nova:owner>
Oct 23 23:06:10 user nova-compute[74482]:   <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:06:10 user nova-compute[74482]:   <nova:ports>
Oct 23 23:06:10 user nova-compute[74482]:     <nova:port uuid="d1739e04-cfa4-4e83-bc72-4f508cbfd0df">
Oct 23 23:06:10 user nova-compute[74482]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 23:06:10 user nova-compute[74482]:     </nova:port>
Oct 23 23:06:10 user nova-compute[74482]:     <nova:port uuid="9c4c4463-b0e7-4bab-8353-6518fa71af9b">
Oct 23 23:06:10 user nova-compute[74482]:       <nova:ip type="fixed" address="10.10.10.26" ipVersion="4"/>
Oct 23 23:06:10 user nova-compute[74482]:     </nova:port>
Oct 23 23:06:10 user nova-compute[74482]:   </nova:ports>
Oct 23 23:06:10 user nova-compute[74482]: </nova:instance>
Oct 23 23:06:10 user nova-compute[74482]:  {{(pid=74482) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e4b4b5b-09f8-439b-a51e-2e3163782663 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "interface-777f18b7-f03c-449f-ad4b-50ebeb67a38b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.080s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG nova.objects.instance [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lazy-loading 'flavor' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:10 user nova-compute[74482]: INFO nova.compute.manager [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Attaching volume 723278ec-5403-4daf-8f36-0bcf35a79543 to /dev/vdb
Oct 23 23:06:10 user nova-compute[74482]: DEBUG os_brick.utils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f67371-8dfa-4ab9-9c6a-d62694f63d05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a30c332-0cdf-40e8-850d-7538805ca779]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9358a098-d42f-4994-8968-8fad2f2ce63a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71a1170-de23-40d4-bdfb-270746283975]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:06:10 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:06:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7102b55d-d250-4f63-a261-ad773af1fdb5]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG os_brick.utils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating existing volume attachment record: 0b2c078e-93d1-40d7-b71e-39d61a60ec73 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-plugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] No waiting events found dispatching network-vif-plugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:11 user nova-compute[74482]: WARNING nova.compute.manager [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received unexpected event network-vif-plugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b for instance with vm_state active and task_state None.
Oct 23 23:06:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-plugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] No waiting events found dispatching network-vif-plugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:11 user nova-compute[74482]: WARNING nova.compute.manager [req-e0419daf-0692-4765-85f2-a149852b6780 req-383e3abb-fadc-4f8d-9455-1a499f1b632f service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received unexpected event network-vif-plugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b for instance with vm_state active and task_state None.
Oct 23 23:06:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-b1a91d25-061e-45d2-b0f7-bfba1fb6cdf2 req-ae3b23b5-7b2d-499f-aeb8-9e2a81fa9f14 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received event network-vif-plugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b1a91d25-061e-45d2-b0f7-bfba1fb6cdf2 req-ae3b23b5-7b2d-499f-aeb8-9e2a81fa9f14 service nova] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b1a91d25-061e-45d2-b0f7-bfba1fb6cdf2 req-ae3b23b5-7b2d-499f-aeb8-9e2a81fa9f14 service nova] Lock "1718ea62-105b-44ac-80f6-587224314449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b1a91d25-061e-45d2-b0f7-bfba1fb6cdf2 req-ae3b23b5-7b2d-499f-aeb8-9e2a81fa9f14 service nova] Lock "1718ea62-105b-44ac-80f6-587224314449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-b1a91d25-061e-45d2-b0f7-bfba1fb6cdf2 req-ae3b23b5-7b2d-499f-aeb8-9e2a81fa9f14 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] No waiting events found dispatching network-vif-plugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:11 user nova-compute[74482]: WARNING nova.compute.manager [req-b1a91d25-061e-45d2-b0f7-bfba1fb6cdf2 req-ae3b23b5-7b2d-499f-aeb8-9e2a81fa9f14 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received unexpected event network-vif-plugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 for instance with vm_state building and task_state spawning.
Oct 23 23:06:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-33815ce2-c23c-4453-88e1-fb590061702d req-e5708f26-a27d-4d00-a1f2-35a4dfa02521 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received event network-vif-plugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33815ce2-c23c-4453-88e1-fb590061702d req-e5708f26-a27d-4d00-a1f2-35a4dfa02521 service nova] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33815ce2-c23c-4453-88e1-fb590061702d req-e5708f26-a27d-4d00-a1f2-35a4dfa02521 service nova] Lock "1718ea62-105b-44ac-80f6-587224314449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-33815ce2-c23c-4453-88e1-fb590061702d req-e5708f26-a27d-4d00-a1f2-35a4dfa02521 service nova] Lock "1718ea62-105b-44ac-80f6-587224314449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-33815ce2-c23c-4453-88e1-fb590061702d req-e5708f26-a27d-4d00-a1f2-35a4dfa02521 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] No waiting events found dispatching network-vif-plugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:13 user nova-compute[74482]: WARNING nova.compute.manager [req-33815ce2-c23c-4453-88e1-fb590061702d req-e5708f26-a27d-4d00-a1f2-35a4dfa02521 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received unexpected event network-vif-plugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 for instance with vm_state building and task_state spawning.
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:06:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 1718ea62-105b-44ac-80f6-587224314449] Instance spawned successfully.
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:06:13 user nova-compute[74482]: INFO nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Took 8.05 seconds to spawn the instance on the hypervisor.
Oct 23 23:06:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:06:13 user nova-compute[74482]: INFO nova.compute.manager [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Took 9.44 seconds to build instance.
Oct 23 23:06:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cfae8fb4-ffdf-4473-bc92-01d602ecc331 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.621s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:06:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:20 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:06:20 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7173MB free_disk=25.069717407226562GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 3b4dc4ee-2f24-46b1-a327-e7b8242e6992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa063829-b117-40f4-93f2-358b33f1d156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 1718ea62-105b-44ac-80f6-587224314449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:06:21 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:06:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:06:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:06:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCvGbUsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:06:30 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:06:30 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:06:30 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f611bd-35be-4192-927e-bc242ead9ae0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:06:30 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[205474b3-05ee-4c5e-a429-b5e3ce2f1007]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543] added
Oct 23 23:06:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3cdcb7-c9a3-4be6-ab49-25198a4066ae]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a179d1b2-51e8-48f3-bdf2-9977ec6b8ea5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCvGbUsJ {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCvGbUsJ" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[819cb346-5bbe-48b1-9339-febe9db582f9]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yCvGbUsJ'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0138b5-0953-4651-9cf6-fc954e1b24f6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8355a33c-101e-410d-b6f3-129fbc8d51cc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb392615-ca76-4216-8ba1-4dd9270b2672]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543, portal: 172.16.0.220,3260]
Oct 23 23:06:30 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543, portal: 172.16.0.220,3260] successful.
Oct 23 23:06:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5be312-03a0-4e76-a812-015851c2325e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d52dca-285a-4d59-978d-d9070c7b3150]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc992ead-728a-4138-98d8-2edd800275e9]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:06:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCvGbUsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:06:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:06:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26436386566656334', 'path': '/dev/sdd'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:06:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436386566656334', 'path': '/dev/sdd'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:06:31 user nova-compute[74482]: DEBUG nova.objects.instance [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lazy-loading 'flavor' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:06:31 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:06:31 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:06:31 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:06:31 user nova-compute[74482]:   <serial>723278ec-5403-4daf-8f36-0bcf35a79543</serial>
Oct 23 23:06:31 user nova-compute[74482]: </disk>
Oct 23 23:06:31 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:06:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:06:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] No BDM found with device name hda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:06:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] No VIF found with MAC fa:16:3e:f4:d5:ac, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:06:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0dc0fa83-5846-457c-92cd-6f6863d003e2 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.628s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:33 user nova-compute[74482]: INFO nova.compute.manager [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Detaching volume 723278ec-5403-4daf-8f36-0bcf35a79543
Oct 23 23:06:33 user nova-compute[74482]: INFO nova.virt.block_device [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Attempting to driver detach volume 723278ec-5403-4daf-8f36-0bcf35a79543 from mountpoint /dev/vdb
Oct 23 23:06:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Attempting to detach device vdb from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:06:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:06:33 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:06:33 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:06:33 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:06:33 user nova-compute[74482]:   <serial>723278ec-5403-4daf-8f36-0bcf35a79543</serial>
Oct 23 23:06:33 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 23:06:33 user nova-compute[74482]: </disk>
Oct 23 23:06:33 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:06:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Successfully detached device vdb from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b from the persistent domain config.
Oct 23 23:06:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:06:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:06:34 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:06:34 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:06:34 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:06:34 user nova-compute[74482]:   <serial>723278ec-5403-4daf-8f36-0bcf35a79543</serial>
Oct 23 23:06:34 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 23:06:34 user nova-compute[74482]: </disk>
Oct 23 23:06:34 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:06:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:38 user nova-compute[74482]: INFO nova.compute.manager [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Terminating instance
Oct 23 23:06:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-53325ca7-a4f9-498b-87ed-0d57ad40da58 req-a5ecedfb-6227-4a83-872c-7f6b5bc0e75b service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-unplugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-53325ca7-a4f9-498b-87ed-0d57ad40da58 req-a5ecedfb-6227-4a83-872c-7f6b5bc0e75b service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-53325ca7-a4f9-498b-87ed-0d57ad40da58 req-a5ecedfb-6227-4a83-872c-7f6b5bc0e75b service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-53325ca7-a4f9-498b-87ed-0d57ad40da58 req-a5ecedfb-6227-4a83-872c-7f6b5bc0e75b service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-53325ca7-a4f9-498b-87ed-0d57ad40da58 req-a5ecedfb-6227-4a83-872c-7f6b5bc0e75b service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-unplugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-53325ca7-a4f9-498b-87ed-0d57ad40da58 req-a5ecedfb-6227-4a83-872c-7f6b5bc0e75b service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-unplugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:06:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Instance destroyed successfully.
Oct 23 23:06:39 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lazy-loading 'resources' on Instance uuid 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-467597565',display_name='tempest-ServerStableDeviceRescueTest-server-467597565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-467597565',id=3,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN59euXmu5u93kXefDnMv2OWRO6hScJjvsthZe+h3yZFekwDxAtA8t7r2Cpcir9cWcpIHxhd6PIwBFk80q1czIYaN1y5u1RJOSWA5KTi76auv9na1jCQ2R/sTX0O0bDjrw==',key_name='tempest-keypair-2115897655',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:03:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d90728bc29a340049b8e038931eaf396',ramdisk_id='',reservation_id='r-19qetahm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1776446221',owner_user_name='tempest-ServerStableDeviceRescueTest-1776446221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db64843c4a004d9fa23a275e43922494',uuid=21d87eb6-effc-4d4f-9f31-80b8d2e15d2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Converting VIF {"id": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "address": "fa:16:3e:f3:68:bb", "network": {"id": "19346391-44d4-4db1-88f0-6561dc27559e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1290464915-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d90728bc29a340049b8e038931eaf396", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdddb3b05-0e", "ovs_interfaceid": "dddb3b05-0e78-459a-ae09-5db2fd55bf4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:68:bb,bridge_name='br-int',has_traffic_filtering=True,id=dddb3b05-0e78-459a-ae09-5db2fd55bf4c,network=Network(19346391-44d4-4db1-88f0-6561dc27559e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddb3b05-0e') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG os_vif [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:68:bb,bridge_name='br-int',has_traffic_filtering=True,id=dddb3b05-0e78-459a-ae09-5db2fd55bf4c,network=Network(19346391-44d4-4db1-88f0-6561dc27559e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddb3b05-0e') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdddb3b05-0e, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01d811ef-47be-4cfc-8b63-ba2628e02c8b) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:06:39 user nova-compute[74482]: INFO os_vif [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:68:bb,bridge_name='br-int',has_traffic_filtering=True,id=dddb3b05-0e78-459a-ae09-5db2fd55bf4c,network=Network(19346391-44d4-4db1-88f0-6561dc27559e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdddb3b05-0e')
Oct 23 23:06:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Deleting instance files /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d_del
Oct 23 23:06:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Deletion of /opt/stack/data/nova/instances/21d87eb6-effc-4d4f-9f31-80b8d2e15d2d_del complete
Oct 23 23:06:39 user nova-compute[74482]: INFO nova.compute.manager [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 23 23:06:39 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:06:39 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:06:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-2e829244-6091-40f1-8686-3c329ef935e7 req-000efe3b-18e1-4268-80c5-7cd1d5e3120f service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-changed-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-2e829244-6091-40f1-8686-3c329ef935e7 req-000efe3b-18e1-4268-80c5-7cd1d5e3120f service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Refreshing instance network info cache due to event network-changed-9b2e69e1-e9e5-47ee-a252-cc7e568d4523. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:06:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2e829244-6091-40f1-8686-3c329ef935e7 req-000efe3b-18e1-4268-80c5-7cd1d5e3120f service nova] Acquiring lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:06:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2e829244-6091-40f1-8686-3c329ef935e7 req-000efe3b-18e1-4268-80c5-7cd1d5e3120f service nova] Acquired lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:06:40 user nova-compute[74482]: DEBUG nova.network.neutron [req-2e829244-6091-40f1-8686-3c329ef935e7 req-000efe3b-18e1-4268-80c5-7cd1d5e3120f service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Refreshing network info cache for port 9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-b566e818-79a2-4134-8a4f-ca909ba6cbf1 req-5988799e-f245-4f8b-80f4-2ced95fb3849 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b566e818-79a2-4134-8a4f-ca909ba6cbf1 req-5988799e-f245-4f8b-80f4-2ced95fb3849 service nova] Acquiring lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b566e818-79a2-4134-8a4f-ca909ba6cbf1 req-5988799e-f245-4f8b-80f4-2ced95fb3849 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b566e818-79a2-4134-8a4f-ca909ba6cbf1 req-5988799e-f245-4f8b-80f4-2ced95fb3849 service nova] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-b566e818-79a2-4134-8a4f-ca909ba6cbf1 req-5988799e-f245-4f8b-80f4-2ced95fb3849 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] No waiting events found dispatching network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:41 user nova-compute[74482]: WARNING nova.compute.manager [req-b566e818-79a2-4134-8a4f-ca909ba6cbf1 req-5988799e-f245-4f8b-80f4-2ced95fb3849 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received unexpected event network-vif-plugged-dddb3b05-0e78-459a-ae09-5db2fd55bf4c for instance with vm_state active and task_state deleting.
Oct 23 23:06:41 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:06:41 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Took 1.62 seconds to deallocate network for instance.
Oct 23 23:06:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-2e829244-6091-40f1-8686-3c329ef935e7 req-000efe3b-18e1-4268-80c5-7cd1d5e3120f service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updated VIF entry in instance network info cache for port 9b2e69e1-e9e5-47ee-a252-cc7e568d4523. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-2e829244-6091-40f1-8686-3c329ef935e7 req-000efe3b-18e1-4268-80c5-7cd1d5e3120f service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updating instance_info_cache with network_info: [{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2e829244-6091-40f1-8686-3c329ef935e7 req-000efe3b-18e1-4268-80c5-7cd1d5e3120f service nova] Releasing lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:06:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:41 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Deleted allocations for instance 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d
Oct 23 23:06:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1ad36c74-9a24-43d2-935c-2c15e97a0143 tempest-ServerStableDeviceRescueTest-1776446221 tempest-ServerStableDeviceRescueTest-1776446221-project-member] Lock "21d87eb6-effc-4d4f-9f31-80b8d2e15d2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.269s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-66c35179-c902-4386-8ffe-d0bd488a630b req-9951f7d9-814b-4a9c-b77d-8b6897489248 service nova] [instance: 21d87eb6-effc-4d4f-9f31-80b8d2e15d2d] Received event network-vif-deleted-dddb3b05-0e78-459a-ae09-5db2fd55bf4c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:46 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:47 user nova-compute[74482]: INFO nova.compute.manager [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Attaching volume 9a907fac-6bfc-418a-9a11-c56983d1ae76 to /dev/vdb
Oct 23 23:06:47 user nova-compute[74482]: DEBUG os_brick.utils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3838b966-9e21-4928-9ff0-122d68371fa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[40edb6df-e6de-42bb-b4c5-76e74054d776]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca17f29-e082-4043-a414-82ef68c6e5cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e64631-284b-4e54-a471-628ba0bb5289]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:06:47 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:06:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[611e1bae-531f-4fb4-9aac-140c7ccd39a4]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG os_brick.utils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:06:47 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updating existing volume attachment record: f571ef38-a7de-4657-894f-5f2e7702754d {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:06:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:54 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b is timed out.
Oct 23 23:06:54 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Successfully detached device vdb from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b from the live domain config.
Oct 23 23:06:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCvGbUsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:06:54 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c79a351-70c8-40c9-83c4-7f5cbaaaf11b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:06:54 user nova-compute[74482]: No targets found.
Oct 23 23:06:54 user nova-compute[74482]: iSNS:
Oct 23 23:06:54 user nova-compute[74482]: No targets found.
Oct 23 23:06:54 user nova-compute[74482]: STATIC:
Oct 23 23:06:54 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543
Oct 23 23:06:54 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:06:54 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:06:54 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:06:54 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:06:54 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:06:54 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62
Oct 23 23:06:54 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:06:54 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:06:54 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:06:54 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:06:54 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:06:54 user nova-compute[74482]: FIRMWARE:
Oct 23 23:06:54 user nova-compute[74482]: No targets found.
Oct 23 23:06:54 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:06:54 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:06:54 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f683577-1eca-4355-bc74-3c4530afe3c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a76ad5-df1f-4e45-adaa-2e204a229db1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:54 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:54 user nova-compute[74482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 (non-flash)
Oct 23 23:06:54 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:54 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:06:54 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:06:54 user nova-compute[74482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 (non-flash)
Oct 23 23:06:54 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:06:54 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c636e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543'): ({'sdd'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Removing single pathed devices sdd {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d45623-32d1-4135-b03b-fa5d1d86fc74]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9bd27a-5c6b-47e1-8af4-b4d111222dfb]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Flushing IO for device /dev/sdd {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9d93fe-2474-4c0c-8983-0ee7e3571be5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6021ea92-4063-4d92-a8de-64c5361ea4f6]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d9b1eb-e285-4f75-ade1-75f6098845f8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f5eac7-147b-4bbd-b819-47218551820f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543, portal: 172.16.0.220,3260]
Oct 23 23:06:54 user nova-compute[74482]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543, portal: 172.16.0.220,3260] successful.
Oct 23 23:06:54 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:723278ec-5403-4daf-8f36-0bcf35a79543 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ebd267-84a5-4c7d-8304-d23f231bc688]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] <== disconnect_volume: return (316ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:06:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:06:55 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lazy-loading 'flavor' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e99101e2-54a4-4515-80e8-60bb5c0f633c tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.779s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "interface-777f18b7-f03c-449f-ad4b-50ebeb67a38b-9c4c4463-b0e7-4bab-8353-6518fa71af9b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "interface-777f18b7-f03c-449f-ad4b-50ebeb67a38b-9c4c4463-b0e7-4bab-8353-6518fa71af9b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.objects.instance [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lazy-loading 'flavor' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1736457799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1736457799',id=14,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qsXrQessntnV1ggy4TtGhnjE2kFMAm3s1+DIHjlcVYXHL0gF6xHKL7xIdhkF0DlXvm8j+JS6shzfqKN69YtxRTbxo+XLeEdMDeMHhyLn/eHYes9kQEt1YgJ6oZynFVA==',key_name='tempest-keypair-1108949033',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8b28ec62224967ab9679d4761e7e67',ramdisk_id='',reservation_id='r-evruxiqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2107078344',owner_user_name='tempest-TaggedAttachmentsTest-2107078344-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0cc3a0ea394dcf85a7ede8e400faf5',uuid=777f18b7-f03c-449f-ad4b-50ebeb67a38b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converting VIF {"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface> {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface> {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Attempting to detach device tap9c4c4463-b0 from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] detach device xml: <interface type="ethernet">
Oct 23 23:06:56 user nova-compute[74482]:   <mac address="fa:16:3e:9e:f1:3e"/>
Oct 23 23:06:56 user nova-compute[74482]:   <model type="virtio"/>
Oct 23 23:06:56 user nova-compute[74482]:   <mtu size="1442"/>
Oct 23 23:06:56 user nova-compute[74482]:   <target dev="tap9c4c4463-b0"/>
Oct 23 23:06:56 user nova-compute[74482]: </interface>
Oct 23 23:06:56 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface> {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface>not found in domain: <domain type='kvm' id='19'>
Oct 23 23:06:56 user nova-compute[74482]:   <name>instance-0000000e</name>
Oct 23 23:06:56 user nova-compute[74482]:   <uuid>777f18b7-f03c-449f-ad4b-50ebeb67a38b</uuid>
Oct 23 23:06:56 user nova-compute[74482]:   <metadata>
Oct 23 23:06:56 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:06:56 user nova-compute[74482]:   <nova:package version="0.0.0"/>
Oct 23 23:06:56 user nova-compute[74482]:   <nova:name>tempest-device-tagging-server-1736457799</nova:name>
Oct 23 23:06:56 user nova-compute[74482]:   <nova:creationTime>2023-10-23 23:06:10</nova:creationTime>
Oct 23 23:06:56 user nova-compute[74482]:   <nova:flavor name="m1.tiny">
Oct 23 23:06:56 user nova-compute[74482]:     <nova:memory>512</nova:memory>
Oct 23 23:06:56 user nova-compute[74482]:     <nova:disk>1</nova:disk>
Oct 23 23:06:56 user nova-compute[74482]:     <nova:swap>0</nova:swap>
Oct 23 23:06:56 user nova-compute[74482]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:06:56 user nova-compute[74482]:     <nova:vcpus>1</nova:vcpus>
Oct 23 23:06:56 user nova-compute[74482]:   </nova:flavor>
Oct 23 23:06:56 user nova-compute[74482]:   <nova:owner>
Oct 23 23:06:56 user nova-compute[74482]:     <nova:user uuid="3a0cc3a0ea394dcf85a7ede8e400faf5">tempest-TaggedAttachmentsTest-2107078344-project-member</nova:user>
Oct 23 23:06:56 user nova-compute[74482]:     <nova:project uuid="2d8b28ec62224967ab9679d4761e7e67">tempest-TaggedAttachmentsTest-2107078344</nova:project>
Oct 23 23:06:56 user nova-compute[74482]:   </nova:owner>
Oct 23 23:06:56 user nova-compute[74482]:   <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:06:56 user nova-compute[74482]:   <nova:ports>
Oct 23 23:06:56 user nova-compute[74482]:     <nova:port uuid="d1739e04-cfa4-4e83-bc72-4f508cbfd0df">
Oct 23 23:06:56 user nova-compute[74482]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 23:06:56 user nova-compute[74482]:     </nova:port>
Oct 23 23:06:56 user nova-compute[74482]:     <nova:port uuid="9c4c4463-b0e7-4bab-8353-6518fa71af9b">
Oct 23 23:06:56 user nova-compute[74482]:       <nova:ip type="fixed" address="10.10.10.26" ipVersion="4"/>
Oct 23 23:06:56 user nova-compute[74482]:     </nova:port>
Oct 23 23:06:56 user nova-compute[74482]:   </nova:ports>
Oct 23 23:06:56 user nova-compute[74482]: </nova:instance>
Oct 23 23:06:56 user nova-compute[74482]:   </metadata>
Oct 23 23:06:56 user nova-compute[74482]:   <memory unit='KiB'>524288</memory>
Oct 23 23:06:56 user nova-compute[74482]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 23:06:56 user nova-compute[74482]:   <vcpu placement='static'>1</vcpu>
Oct 23 23:06:56 user nova-compute[74482]:   <resource>
Oct 23 23:06:56 user nova-compute[74482]:     <partition>/machine</partition>
Oct 23 23:06:56 user nova-compute[74482]:   </resource>
Oct 23 23:06:56 user nova-compute[74482]:   <sysinfo type='smbios'>
Oct 23 23:06:56 user nova-compute[74482]:     <system>
Oct 23 23:06:56 user nova-compute[74482]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 23:06:56 user nova-compute[74482]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 23:06:56 user nova-compute[74482]:       <entry name='version'>0.0.0</entry>
Oct 23 23:06:56 user nova-compute[74482]:       <entry name='serial'>777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:06:56 user nova-compute[74482]:       <entry name='uuid'>777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:06:56 user nova-compute[74482]:       <entry name='family'>Virtual Machine</entry>
Oct 23 23:06:56 user nova-compute[74482]:     </system>
Oct 23 23:06:56 user nova-compute[74482]:   </sysinfo>
Oct 23 23:06:56 user nova-compute[74482]:   <os>
Oct 23 23:06:56 user nova-compute[74482]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 23:06:56 user nova-compute[74482]:     <boot dev='hd'/>
Oct 23 23:06:56 user nova-compute[74482]:     <smbios mode='sysinfo'/>
Oct 23 23:06:56 user nova-compute[74482]:   </os>
Oct 23 23:06:56 user nova-compute[74482]:   <features>
Oct 23 23:06:56 user nova-compute[74482]:     <acpi/>
Oct 23 23:06:56 user nova-compute[74482]:     <apic/>
Oct 23 23:06:56 user nova-compute[74482]:     <vmcoreinfo state='on'/>
Oct 23 23:06:56 user nova-compute[74482]:   </features>
Oct 23 23:06:56 user nova-compute[74482]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 23:06:56 user nova-compute[74482]:     <model fallback='forbid'>Nehalem</model>
Oct 23 23:06:56 user nova-compute[74482]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 23:06:56 user nova-compute[74482]:     <feature policy='require' name='vme'/>
Oct 23 23:06:56 user nova-compute[74482]:     <feature policy='require' name='x2apic'/>
Oct 23 23:06:56 user nova-compute[74482]:     <feature policy='require' name='hypervisor'/>
Oct 23 23:06:56 user nova-compute[74482]:   </cpu>
Oct 23 23:06:56 user nova-compute[74482]:   <clock offset='utc'>
Oct 23 23:06:56 user nova-compute[74482]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 23:06:56 user nova-compute[74482]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 23:06:56 user nova-compute[74482]:     <timer name='hpet' present='no'/>
Oct 23 23:06:56 user nova-compute[74482]:   </clock>
Oct 23 23:06:56 user nova-compute[74482]:   <on_poweroff>destroy</on_poweroff>
Oct 23 23:06:56 user nova-compute[74482]:   <on_reboot>restart</on_reboot>
Oct 23 23:06:56 user nova-compute[74482]:   <on_crash>destroy</on_crash>
Oct 23 23:06:56 user nova-compute[74482]:   <devices>
Oct 23 23:06:56 user nova-compute[74482]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 23:06:56 user nova-compute[74482]:     <disk type='file' device='disk'>
Oct 23 23:06:56 user nova-compute[74482]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 23:06:56 user nova-compute[74482]:       <source file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk' index='2'/>
Oct 23 23:06:56 user nova-compute[74482]:       <backingStore type='file' index='3'>
Oct 23 23:06:56 user nova-compute[74482]:         <format type='raw'/>
Oct 23 23:06:56 user nova-compute[74482]:         <source file='/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae'/>
Oct 23 23:06:56 user nova-compute[74482]:         <backingStore/>
Oct 23 23:06:56 user nova-compute[74482]:       </backingStore>
Oct 23 23:06:56 user nova-compute[74482]:       <target dev='vda' bus='virtio'/>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='virtio-disk0'/>
Oct 23 23:06:56 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </disk>
Oct 23 23:06:56 user nova-compute[74482]:     <disk type='file' device='cdrom'>
Oct 23 23:06:56 user nova-compute[74482]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 23:06:56 user nova-compute[74482]:       <source file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.config' index='1'/>
Oct 23 23:06:56 user nova-compute[74482]:       <backingStore/>
Oct 23 23:06:56 user nova-compute[74482]:       <target dev='hda' bus='ide'/>
Oct 23 23:06:56 user nova-compute[74482]:       <readonly/>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='ide0-0-0'/>
Oct 23 23:06:56 user nova-compute[74482]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </disk>
Oct 23 23:06:56 user nova-compute[74482]:     <controller type='usb' index='0' model='none'>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='usb'/>
Oct 23 23:06:56 user nova-compute[74482]:     </controller>
Oct 23 23:06:56 user nova-compute[74482]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='pci.0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </controller>
Oct 23 23:06:56 user nova-compute[74482]:     <controller type='ide' index='0'>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='ide'/>
Oct 23 23:06:56 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 23:06:56 user nova-compute[74482]:     </controller>
Oct 23 23:06:56 user nova-compute[74482]:     <interface type='ethernet'>
Oct 23 23:06:56 user nova-compute[74482]:       <mac address='fa:16:3e:f4:d5:ac'/>
Oct 23 23:06:56 user nova-compute[74482]:       <target dev='tapd1739e04-cf'/>
Oct 23 23:06:56 user nova-compute[74482]:       <model type='virtio'/>
Oct 23 23:06:56 user nova-compute[74482]:       <mtu size='1442'/>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='net0'/>
Oct 23 23:06:56 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </interface>
Oct 23 23:06:56 user nova-compute[74482]:     <interface type='ethernet'>
Oct 23 23:06:56 user nova-compute[74482]:       <mac address='fa:16:3e:9e:f1:3e'/>
Oct 23 23:06:56 user nova-compute[74482]:       <target dev='tap9c4c4463-b0'/>
Oct 23 23:06:56 user nova-compute[74482]:       <model type='virtio'/>
Oct 23 23:06:56 user nova-compute[74482]:       <mtu size='1442'/>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='net1'/>
Oct 23 23:06:56 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </interface>
Oct 23 23:06:56 user nova-compute[74482]:     <serial type='pty'>
Oct 23 23:06:56 user nova-compute[74482]:       <source path='/dev/pts/9'/>
Oct 23 23:06:56 user nova-compute[74482]:       <log file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log' append='off'/>
Oct 23 23:06:56 user nova-compute[74482]:       <target type='isa-serial' port='0'>
Oct 23 23:06:56 user nova-compute[74482]:         <model name='isa-serial'/>
Oct 23 23:06:56 user nova-compute[74482]:       </target>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='serial0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </serial>
Oct 23 23:06:56 user nova-compute[74482]:     <console type='pty' tty='/dev/pts/9'>
Oct 23 23:06:56 user nova-compute[74482]:       <source path='/dev/pts/9'/>
Oct 23 23:06:56 user nova-compute[74482]:       <log file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log' append='off'/>
Oct 23 23:06:56 user nova-compute[74482]:       <target type='serial' port='0'/>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='serial0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </console>
Oct 23 23:06:56 user nova-compute[74482]:     <input type='mouse' bus='ps2'>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='input0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </input>
Oct 23 23:06:56 user nova-compute[74482]:     <input type='keyboard' bus='ps2'>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='input1'/>
Oct 23 23:06:56 user nova-compute[74482]:     </input>
Oct 23 23:06:56 user nova-compute[74482]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 23 23:06:56 user nova-compute[74482]:       <listen type='address' address='0.0.0.0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </graphics>
Oct 23 23:06:56 user nova-compute[74482]:     <audio id='1' type='none'/>
Oct 23 23:06:56 user nova-compute[74482]:     <video>
Oct 23 23:06:56 user nova-compute[74482]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='video0'/>
Oct 23 23:06:56 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </video>
Oct 23 23:06:56 user nova-compute[74482]:     <memballoon model='virtio'>
Oct 23 23:06:56 user nova-compute[74482]:       <stats period='10'/>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='balloon0'/>
Oct 23 23:06:56 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </memballoon>
Oct 23 23:06:56 user nova-compute[74482]:     <rng model='virtio'>
Oct 23 23:06:56 user nova-compute[74482]:       <backend model='random'>/dev/urandom</backend>
Oct 23 23:06:56 user nova-compute[74482]:       <alias name='rng0'/>
Oct 23 23:06:56 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 23:06:56 user nova-compute[74482]:     </rng>
Oct 23 23:06:56 user nova-compute[74482]:   </devices>
Oct 23 23:06:56 user nova-compute[74482]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 23:06:56 user nova-compute[74482]:     <label>libvirt-777f18b7-f03c-449f-ad4b-50ebeb67a38b</label>
Oct 23 23:06:56 user nova-compute[74482]:     <imagelabel>libvirt-777f18b7-f03c-449f-ad4b-50ebeb67a38b</imagelabel>
Oct 23 23:06:56 user nova-compute[74482]:   </seclabel>
Oct 23 23:06:56 user nova-compute[74482]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 23:06:56 user nova-compute[74482]:     <label>+64055:+108</label>
Oct 23 23:06:56 user nova-compute[74482]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 23:06:56 user nova-compute[74482]:   </seclabel>
Oct 23 23:06:56 user nova-compute[74482]: </domain>
Oct 23 23:06:56 user nova-compute[74482]:  {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 23:06:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Successfully detached device tap9c4c4463-b0 from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b from the persistent domain config.
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] (1/8): Attempting to detach device tap9c4c4463-b0 with device alias net1 from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] detach device xml: <interface type="ethernet">
Oct 23 23:06:56 user nova-compute[74482]:   <mac address="fa:16:3e:9e:f1:3e"/>
Oct 23 23:06:56 user nova-compute[74482]:   <model type="virtio"/>
Oct 23 23:06:56 user nova-compute[74482]:   <mtu size="1442"/>
Oct 23 23:06:56 user nova-compute[74482]:   <target dev="tap9c4c4463-b0"/>
Oct 23 23:06:56 user nova-compute[74482]: </interface>
Oct 23 23:06:56 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Start waiting for the detach event from libvirt for device tap9c4c4463-b0 with device alias net1 for instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-ca1b0707-dcc3-4a8d-a1ad-544ebbd6ad0a req-af145190-2fab-4f02-925d-95897ea5a231 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-unplugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ca1b0707-dcc3-4a8d-a1ad-544ebbd6ad0a req-af145190-2fab-4f02-925d-95897ea5a231 service nova] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ca1b0707-dcc3-4a8d-a1ad-544ebbd6ad0a req-af145190-2fab-4f02-925d-95897ea5a231 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ca1b0707-dcc3-4a8d-a1ad-544ebbd6ad0a req-af145190-2fab-4f02-925d-95897ea5a231 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-ca1b0707-dcc3-4a8d-a1ad-544ebbd6ad0a req-af145190-2fab-4f02-925d-95897ea5a231 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] No waiting events found dispatching network-vif-unplugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:57 user nova-compute[74482]: WARNING nova.compute.manager [req-ca1b0707-dcc3-4a8d-a1ad-544ebbd6ad0a req-af145190-2fab-4f02-925d-95897ea5a231 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received unexpected event network-vif-unplugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b for instance with vm_state active and task_state None.
Oct 23 23:06:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:06:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-11e58529-5fa1-486d-bfe7-a0e0fd526ae6 req-5668186c-b387-477e-85c8-f9bcfbd77a50 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-plugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:06:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-11e58529-5fa1-486d-bfe7-a0e0fd526ae6 req-5668186c-b387-477e-85c8-f9bcfbd77a50 service nova] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:06:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-11e58529-5fa1-486d-bfe7-a0e0fd526ae6 req-5668186c-b387-477e-85c8-f9bcfbd77a50 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:06:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-11e58529-5fa1-486d-bfe7-a0e0fd526ae6 req-5668186c-b387-477e-85c8-f9bcfbd77a50 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:06:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-11e58529-5fa1-486d-bfe7-a0e0fd526ae6 req-5668186c-b387-477e-85c8-f9bcfbd77a50 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] No waiting events found dispatching network-vif-plugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:06:59 user nova-compute[74482]: WARNING nova.compute.manager [req-11e58529-5fa1-486d-bfe7-a0e0fd526ae6 req-5668186c-b387-477e-85c8-f9bcfbd77a50 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received unexpected event network-vif-plugged-9c4c4463-b0e7-4bab-8353-6518fa71af9b for instance with vm_state active and task_state None.
Oct 23 23:06:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVskdhMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:07:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:07:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:07:04 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c881b8d-f823-44b1-84db-53eb671b6a93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:07:04 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7439e570-4638-4eaa-9647-a7307a36ca7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76] added
Oct 23 23:07:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6c816a-6300-4b6c-ac0d-6bc5a7788726]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf714553-2d3d-4334-8ea2-cee5cd47be76]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVskdhMI {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVskdhMI" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc05b6-d276-449b-8c18-ac12748b6587]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVskdhMI'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa1bcb4-11e6-4c41-b195-a5316b53a1b4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf86ba-1217-4b7b-b2af-683b49d08f7a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7063ddc0-57ca-4452-9c0d-9993403c0d62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260]
Oct 23 23:07:04 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260] successful.
Oct 23 23:07:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ed3a32-95a7-4316-ba09-67cbdcb8cabd]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba1e8e1-1a94-4098-9f2f-b3856d6cdb2b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:07:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb429aae-ff1f-4a5c-b9bc-9a4421510b8b]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:07:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVskdhMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:07:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:07:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26561353664393136', 'path': '/dev/sdd'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:07:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561353664393136', 'path': '/dev/sdd'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:07:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:07:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:07:05 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:07:05 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:07:05 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:07:05 user nova-compute[74482]:   <serial>9a907fac-6bfc-418a-9a11-c56983d1ae76</serial>
Oct 23 23:07:05 user nova-compute[74482]: </disk>
Oct 23 23:07:05 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:07:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:07:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:07:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No VIF found with MAC fa:16:3e:f4:77:36, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:07:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4af67a87-57ee-4dd8-9fe8-57e36b4b2185 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.415s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:07 user nova-compute[74482]: INFO nova.compute.manager [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Terminating instance
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-21a330dc-750a-4625-b981-4cad6189d836 req-a0137833-ce13-4b3c-aab7-ba81d4b079ce service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received event network-vif-unplugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-21a330dc-750a-4625-b981-4cad6189d836 req-a0137833-ce13-4b3c-aab7-ba81d4b079ce service nova] Acquiring lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-21a330dc-750a-4625-b981-4cad6189d836 req-a0137833-ce13-4b3c-aab7-ba81d4b079ce service nova] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-21a330dc-750a-4625-b981-4cad6189d836 req-a0137833-ce13-4b3c-aab7-ba81d4b079ce service nova] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-21a330dc-750a-4625-b981-4cad6189d836 req-a0137833-ce13-4b3c-aab7-ba81d4b079ce service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] No waiting events found dispatching network-vif-unplugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-21a330dc-750a-4625-b981-4cad6189d836 req-a0137833-ce13-4b3c-aab7-ba81d4b079ce service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received event network-vif-unplugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Instance destroyed successfully.
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lazy-loading 'resources' on Instance uuid 3b4dc4ee-2f24-46b1-a327-e7b8242e6992 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1642845092',display_name='tempest-VolumesActionsTest-instance-1642845092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1642845092',id=16,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:05:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a325a57cab5d4baea61d50a50d520b1c',ramdisk_id='',reservation_id='r-tx6tokvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-732614350',owner_user_name='tempest-VolumesActionsTest-732614350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:05:29Z,user_data=None,user_id='875daa8820804264a89ecfc2c6884fa1',uuid=3b4dc4ee-2f24-46b1-a327-e7b8242e6992,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converting VIF {"id": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "address": "fa:16:3e:ba:2a:c0", "network": {"id": "af958f4e-1a3f-4a7f-a7f4-8816ab415456", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2137541520-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a325a57cab5d4baea61d50a50d520b1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace7343-04", "ovs_interfaceid": "1ace7343-041a-42b1-b1aa-2a3e34b86c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:c0,bridge_name='br-int',has_traffic_filtering=True,id=1ace7343-041a-42b1-b1aa-2a3e34b86c96,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace7343-04') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG os_vif [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:c0,bridge_name='br-int',has_traffic_filtering=True,id=1ace7343-041a-42b1-b1aa-2a3e34b86c96,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace7343-04') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ace7343-04, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1e35908-0c59-4ff8-b54e-f8c7203efc23) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-021d7ce3-3fe3-48a9-9d7a-d1b3e710f37a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-021d7ce3-3fe3-48a9-9d7a-d1b3e710f37a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-021d7ce3-3fe3-48a9-9d7a-d1b3e710f37a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-021d7ce3-3fe3-48a9-9d7a-d1b3e710f37a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74482) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-021d7ce3-3fe3-48a9-9d7a-d1b3e710f37a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: INFO os_vif [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:2a:c0,bridge_name='br-int',has_traffic_filtering=True,id=1ace7343-041a-42b1-b1aa-2a3e34b86c96,network=Network(af958f4e-1a3f-4a7f-a7f4-8816ab415456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace7343-04')
Oct 23 23:07:07 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Deleting instance files /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992_del
Oct 23 23:07:07 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Deletion of /opt/stack/data/nova/instances/3b4dc4ee-2f24-46b1-a327-e7b8242e6992_del complete
Oct 23 23:07:07 user nova-compute[74482]: INFO nova.compute.manager [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 23 23:07:07 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-a667cfb4-d52b-46f5-9f96-b6d533177ca4 req-41d2d34a-c320-40bd-ac75-b32fe1b15bf3 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-unplugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a667cfb4-d52b-46f5-9f96-b6d533177ca4 req-41d2d34a-c320-40bd-ac75-b32fe1b15bf3 service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a667cfb4-d52b-46f5-9f96-b6d533177ca4 req-41d2d34a-c320-40bd-ac75-b32fe1b15bf3 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a667cfb4-d52b-46f5-9f96-b6d533177ca4 req-41d2d34a-c320-40bd-ac75-b32fe1b15bf3 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-a667cfb4-d52b-46f5-9f96-b6d533177ca4 req-41d2d34a-c320-40bd-ac75-b32fe1b15bf3 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-unplugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:07:08 user nova-compute[74482]: WARNING nova.compute.manager [req-a667cfb4-d52b-46f5-9f96-b6d533177ca4 req-41d2d34a-c320-40bd-ac75-b32fe1b15bf3 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-unplugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state active and task_state powering-off.
Oct 23 23:07:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance destroyed successfully.
Oct 23 23:07:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-021d7ce3-3fe3-48a9-9d7a-d1b3e710f37a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:07:08 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:07:08 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Took 0.83 seconds to deallocate network for instance.
Oct 23 23:07:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-021d7ce3-3fe3-48a9-9d7a-d1b3e710f37a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.937s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:09 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:07:09 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:07:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:09 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Deleted allocations for instance 3b4dc4ee-2f24-46b1-a327-e7b8242e6992
Oct 23 23:07:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dae1c1a1-1d54-4a03-b30d-f44850637677 tempest-VolumesActionsTest-732614350 tempest-VolumesActionsTest-732614350-project-member] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-3a8bcc6e-6b6b-4ad4-b69e-95b95f730459 req-5b274d35-77a3-4fdc-aa90-787581854992 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received event network-vif-plugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3a8bcc6e-6b6b-4ad4-b69e-95b95f730459 req-5b274d35-77a3-4fdc-aa90-787581854992 service nova] Acquiring lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3a8bcc6e-6b6b-4ad4-b69e-95b95f730459 req-5b274d35-77a3-4fdc-aa90-787581854992 service nova] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3a8bcc6e-6b6b-4ad4-b69e-95b95f730459 req-5b274d35-77a3-4fdc-aa90-787581854992 service nova] Lock "3b4dc4ee-2f24-46b1-a327-e7b8242e6992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-3a8bcc6e-6b6b-4ad4-b69e-95b95f730459 req-5b274d35-77a3-4fdc-aa90-787581854992 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] No waiting events found dispatching network-vif-plugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:07:09 user nova-compute[74482]: WARNING nova.compute.manager [req-3a8bcc6e-6b6b-4ad4-b69e-95b95f730459 req-5b274d35-77a3-4fdc-aa90-787581854992 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received unexpected event network-vif-plugged-1ace7343-041a-42b1-b1aa-2a3e34b86c96 for instance with vm_state deleted and task_state None.
Oct 23 23:07:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-3bdba002-0a19-42e6-af43-46bcb39a0044 req-ebf80f7a-367b-4667-8b1c-cae58f2ccf32 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3bdba002-0a19-42e6-af43-46bcb39a0044 req-ebf80f7a-367b-4667-8b1c-cae58f2ccf32 service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3bdba002-0a19-42e6-af43-46bcb39a0044 req-ebf80f7a-367b-4667-8b1c-cae58f2ccf32 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3bdba002-0a19-42e6-af43-46bcb39a0044 req-ebf80f7a-367b-4667-8b1c-cae58f2ccf32 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-3bdba002-0a19-42e6-af43-46bcb39a0044 req-ebf80f7a-367b-4667-8b1c-cae58f2ccf32 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:07:10 user nova-compute[74482]: WARNING nova.compute.manager [req-3bdba002-0a19-42e6-af43-46bcb39a0044 req-ebf80f7a-367b-4667-8b1c-cae58f2ccf32 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state stopped and task_state None.
Oct 23 23:07:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-3bdba002-0a19-42e6-af43-46bcb39a0044 req-ebf80f7a-367b-4667-8b1c-cae58f2ccf32 service nova] [instance: 3b4dc4ee-2f24-46b1-a327-e7b8242e6992] Received event network-vif-deleted-1ace7343-041a-42b1-b1aa-2a3e34b86c96 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:16 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Waiting for libvirt event about the detach of device tap9c4c4463-b0 with device alias net1 from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b is timed out.
Oct 23 23:07:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface> {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface>not found in domain: <domain type='kvm' id='19'>
Oct 23 23:07:16 user nova-compute[74482]:   <name>instance-0000000e</name>
Oct 23 23:07:16 user nova-compute[74482]:   <uuid>777f18b7-f03c-449f-ad4b-50ebeb67a38b</uuid>
Oct 23 23:07:16 user nova-compute[74482]:   <metadata>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:07:16 user nova-compute[74482]:   <nova:package version="0.0.0"/>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:name>tempest-device-tagging-server-1736457799</nova:name>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:creationTime>2023-10-23 23:06:10</nova:creationTime>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:flavor name="m1.tiny">
Oct 23 23:07:16 user nova-compute[74482]:     <nova:memory>512</nova:memory>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:disk>1</nova:disk>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:swap>0</nova:swap>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:vcpus>1</nova:vcpus>
Oct 23 23:07:16 user nova-compute[74482]:   </nova:flavor>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:owner>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:user uuid="3a0cc3a0ea394dcf85a7ede8e400faf5">tempest-TaggedAttachmentsTest-2107078344-project-member</nova:user>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:project uuid="2d8b28ec62224967ab9679d4761e7e67">tempest-TaggedAttachmentsTest-2107078344</nova:project>
Oct 23 23:07:16 user nova-compute[74482]:   </nova:owner>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:ports>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:port uuid="d1739e04-cfa4-4e83-bc72-4f508cbfd0df">
Oct 23 23:07:16 user nova-compute[74482]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 23:07:16 user nova-compute[74482]:     </nova:port>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:port uuid="9c4c4463-b0e7-4bab-8353-6518fa71af9b">
Oct 23 23:07:16 user nova-compute[74482]:       <nova:ip type="fixed" address="10.10.10.26" ipVersion="4"/>
Oct 23 23:07:16 user nova-compute[74482]:     </nova:port>
Oct 23 23:07:16 user nova-compute[74482]:   </nova:ports>
Oct 23 23:07:16 user nova-compute[74482]: </nova:instance>
Oct 23 23:07:16 user nova-compute[74482]:   </metadata>
Oct 23 23:07:16 user nova-compute[74482]:   <memory unit='KiB'>524288</memory>
Oct 23 23:07:16 user nova-compute[74482]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 23:07:16 user nova-compute[74482]:   <vcpu placement='static'>1</vcpu>
Oct 23 23:07:16 user nova-compute[74482]:   <resource>
Oct 23 23:07:16 user nova-compute[74482]:     <partition>/machine</partition>
Oct 23 23:07:16 user nova-compute[74482]:   </resource>
Oct 23 23:07:16 user nova-compute[74482]:   <sysinfo type='smbios'>
Oct 23 23:07:16 user nova-compute[74482]:     <system>
Oct 23 23:07:16 user nova-compute[74482]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 23:07:16 user nova-compute[74482]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 23:07:16 user nova-compute[74482]:       <entry name='version'>0.0.0</entry>
Oct 23 23:07:16 user nova-compute[74482]:       <entry name='serial'>777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:07:16 user nova-compute[74482]:       <entry name='uuid'>777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:07:16 user nova-compute[74482]:       <entry name='family'>Virtual Machine</entry>
Oct 23 23:07:16 user nova-compute[74482]:     </system>
Oct 23 23:07:16 user nova-compute[74482]:   </sysinfo>
Oct 23 23:07:16 user nova-compute[74482]:   <os>
Oct 23 23:07:16 user nova-compute[74482]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 23:07:16 user nova-compute[74482]:     <boot dev='hd'/>
Oct 23 23:07:16 user nova-compute[74482]:     <smbios mode='sysinfo'/>
Oct 23 23:07:16 user nova-compute[74482]:   </os>
Oct 23 23:07:16 user nova-compute[74482]:   <features>
Oct 23 23:07:16 user nova-compute[74482]:     <acpi/>
Oct 23 23:07:16 user nova-compute[74482]:     <apic/>
Oct 23 23:07:16 user nova-compute[74482]:     <vmcoreinfo state='on'/>
Oct 23 23:07:16 user nova-compute[74482]:   </features>
Oct 23 23:07:16 user nova-compute[74482]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 23:07:16 user nova-compute[74482]:     <model fallback='forbid'>Nehalem</model>
Oct 23 23:07:16 user nova-compute[74482]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 23:07:16 user nova-compute[74482]:     <feature policy='require' name='vme'/>
Oct 23 23:07:16 user nova-compute[74482]:     <feature policy='require' name='x2apic'/>
Oct 23 23:07:16 user nova-compute[74482]:     <feature policy='require' name='hypervisor'/>
Oct 23 23:07:16 user nova-compute[74482]:   </cpu>
Oct 23 23:07:16 user nova-compute[74482]:   <clock offset='utc'>
Oct 23 23:07:16 user nova-compute[74482]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 23:07:16 user nova-compute[74482]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 23:07:16 user nova-compute[74482]:     <timer name='hpet' present='no'/>
Oct 23 23:07:16 user nova-compute[74482]:   </clock>
Oct 23 23:07:16 user nova-compute[74482]:   <on_poweroff>destroy</on_poweroff>
Oct 23 23:07:16 user nova-compute[74482]:   <on_reboot>restart</on_reboot>
Oct 23 23:07:16 user nova-compute[74482]:   <on_crash>destroy</on_crash>
Oct 23 23:07:16 user nova-compute[74482]:   <devices>
Oct 23 23:07:16 user nova-compute[74482]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 23:07:16 user nova-compute[74482]:     <disk type='file' device='disk'>
Oct 23 23:07:16 user nova-compute[74482]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 23:07:16 user nova-compute[74482]:       <source file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk' index='2'/>
Oct 23 23:07:16 user nova-compute[74482]:       <backingStore type='file' index='3'>
Oct 23 23:07:16 user nova-compute[74482]:         <format type='raw'/>
Oct 23 23:07:16 user nova-compute[74482]:         <source file='/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae'/>
Oct 23 23:07:16 user nova-compute[74482]:         <backingStore/>
Oct 23 23:07:16 user nova-compute[74482]:       </backingStore>
Oct 23 23:07:16 user nova-compute[74482]:       <target dev='vda' bus='virtio'/>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='virtio-disk0'/>
Oct 23 23:07:16 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </disk>
Oct 23 23:07:16 user nova-compute[74482]:     <disk type='file' device='cdrom'>
Oct 23 23:07:16 user nova-compute[74482]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 23:07:16 user nova-compute[74482]:       <source file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.config' index='1'/>
Oct 23 23:07:16 user nova-compute[74482]:       <backingStore/>
Oct 23 23:07:16 user nova-compute[74482]:       <target dev='hda' bus='ide'/>
Oct 23 23:07:16 user nova-compute[74482]:       <readonly/>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='ide0-0-0'/>
Oct 23 23:07:16 user nova-compute[74482]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </disk>
Oct 23 23:07:16 user nova-compute[74482]:     <controller type='usb' index='0' model='none'>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='usb'/>
Oct 23 23:07:16 user nova-compute[74482]:     </controller>
Oct 23 23:07:16 user nova-compute[74482]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='pci.0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </controller>
Oct 23 23:07:16 user nova-compute[74482]:     <controller type='ide' index='0'>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='ide'/>
Oct 23 23:07:16 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 23:07:16 user nova-compute[74482]:     </controller>
Oct 23 23:07:16 user nova-compute[74482]:     <interface type='ethernet'>
Oct 23 23:07:16 user nova-compute[74482]:       <mac address='fa:16:3e:f4:d5:ac'/>
Oct 23 23:07:16 user nova-compute[74482]:       <target dev='tapd1739e04-cf'/>
Oct 23 23:07:16 user nova-compute[74482]:       <model type='virtio'/>
Oct 23 23:07:16 user nova-compute[74482]:       <mtu size='1442'/>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='net0'/>
Oct 23 23:07:16 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </interface>
Oct 23 23:07:16 user nova-compute[74482]:     <serial type='pty'>
Oct 23 23:07:16 user nova-compute[74482]:       <source path='/dev/pts/9'/>
Oct 23 23:07:16 user nova-compute[74482]:       <log file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log' append='off'/>
Oct 23 23:07:16 user nova-compute[74482]:       <target type='isa-serial' port='0'>
Oct 23 23:07:16 user nova-compute[74482]:         <model name='isa-serial'/>
Oct 23 23:07:16 user nova-compute[74482]:       </target>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='serial0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </serial>
Oct 23 23:07:16 user nova-compute[74482]:     <console type='pty' tty='/dev/pts/9'>
Oct 23 23:07:16 user nova-compute[74482]:       <source path='/dev/pts/9'/>
Oct 23 23:07:16 user nova-compute[74482]:       <log file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log' append='off'/>
Oct 23 23:07:16 user nova-compute[74482]:       <target type='serial' port='0'/>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='serial0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </console>
Oct 23 23:07:16 user nova-compute[74482]:     <input type='mouse' bus='ps2'>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='input0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </input>
Oct 23 23:07:16 user nova-compute[74482]:     <input type='keyboard' bus='ps2'>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='input1'/>
Oct 23 23:07:16 user nova-compute[74482]:     </input>
Oct 23 23:07:16 user nova-compute[74482]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 23 23:07:16 user nova-compute[74482]:       <listen type='address' address='0.0.0.0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </graphics>
Oct 23 23:07:16 user nova-compute[74482]:     <audio id='1' type='none'/>
Oct 23 23:07:16 user nova-compute[74482]:     <video>
Oct 23 23:07:16 user nova-compute[74482]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='video0'/>
Oct 23 23:07:16 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </video>
Oct 23 23:07:16 user nova-compute[74482]:     <memballoon model='virtio'>
Oct 23 23:07:16 user nova-compute[74482]:       <stats period='10'/>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='balloon0'/>
Oct 23 23:07:16 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </memballoon>
Oct 23 23:07:16 user nova-compute[74482]:     <rng model='virtio'>
Oct 23 23:07:16 user nova-compute[74482]:       <backend model='random'>/dev/urandom</backend>
Oct 23 23:07:16 user nova-compute[74482]:       <alias name='rng0'/>
Oct 23 23:07:16 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 23:07:16 user nova-compute[74482]:     </rng>
Oct 23 23:07:16 user nova-compute[74482]:   </devices>
Oct 23 23:07:16 user nova-compute[74482]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 23:07:16 user nova-compute[74482]:     <label>libvirt-777f18b7-f03c-449f-ad4b-50ebeb67a38b</label>
Oct 23 23:07:16 user nova-compute[74482]:     <imagelabel>libvirt-777f18b7-f03c-449f-ad4b-50ebeb67a38b</imagelabel>
Oct 23 23:07:16 user nova-compute[74482]:   </seclabel>
Oct 23 23:07:16 user nova-compute[74482]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 23:07:16 user nova-compute[74482]:     <label>+64055:+108</label>
Oct 23 23:07:16 user nova-compute[74482]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 23:07:16 user nova-compute[74482]:   </seclabel>
Oct 23 23:07:16 user nova-compute[74482]: </domain>
Oct 23 23:07:16 user nova-compute[74482]:  {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 23:07:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Successfully detached device tap9c4c4463-b0 from instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b from the live domain config.
Oct 23 23:07:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1736457799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1736457799',id=14,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qsXrQessntnV1ggy4TtGhnjE2kFMAm3s1+DIHjlcVYXHL0gF6xHKL7xIdhkF0DlXvm8j+JS6shzfqKN69YtxRTbxo+XLeEdMDeMHhyLn/eHYes9kQEt1YgJ6oZynFVA==',key_name='tempest-keypair-1108949033',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8b28ec62224967ab9679d4761e7e67',ramdisk_id='',reservation_id='r-evruxiqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2107078344',owner_user_name='tempest-TaggedAttachmentsTest-2107078344-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0cc3a0ea394dcf85a7ede8e400faf5',uuid=777f18b7-f03c-449f-ad4b-50ebeb67a38b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converting VIF {"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG os_vif [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c4c4463-b0, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15c38db3-3fb2-4bf2-a2a2-e27b8427fdda) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:16 user nova-compute[74482]: INFO os_vif [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0')
Oct 23 23:07:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:07:16 user nova-compute[74482]:   <nova:package version="0.0.0"/>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:name>tempest-device-tagging-server-1736457799</nova:name>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:creationTime>2023-10-23 23:07:16</nova:creationTime>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:flavor name="m1.tiny">
Oct 23 23:07:16 user nova-compute[74482]:     <nova:memory>512</nova:memory>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:disk>1</nova:disk>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:swap>0</nova:swap>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:vcpus>1</nova:vcpus>
Oct 23 23:07:16 user nova-compute[74482]:   </nova:flavor>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:owner>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:user uuid="3a0cc3a0ea394dcf85a7ede8e400faf5">tempest-TaggedAttachmentsTest-2107078344-project-member</nova:user>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:project uuid="2d8b28ec62224967ab9679d4761e7e67">tempest-TaggedAttachmentsTest-2107078344</nova:project>
Oct 23 23:07:16 user nova-compute[74482]:   </nova:owner>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:07:16 user nova-compute[74482]:   <nova:ports>
Oct 23 23:07:16 user nova-compute[74482]:     <nova:port uuid="d1739e04-cfa4-4e83-bc72-4f508cbfd0df">
Oct 23 23:07:16 user nova-compute[74482]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 23:07:16 user nova-compute[74482]:     </nova:port>
Oct 23 23:07:16 user nova-compute[74482]:   </nova:ports>
Oct 23 23:07:16 user nova-compute[74482]: </nova:instance>
Oct 23 23:07:16 user nova-compute[74482]:  {{(pid=74482) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-deleted-9c4c4463-b0e7-4bab-8353-6518fa71af9b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:17 user nova-compute[74482]: INFO nova.compute.manager [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Neutron deleted interface 9c4c4463-b0e7-4bab-8353-6518fa71af9b; detaching it from the instance and deleting it from the info cache
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.network.neutron [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating instance_info_cache with network_info: [{"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquired lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.objects.instance [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] Lazy-loading 'system_metadata' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.objects.instance [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] Lazy-loading 'flavor' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.objects.base [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] Object Instance<777f18b7-f03c-449f-ad4b-50ebeb67a38b> lazy-loaded attributes: system_metadata,flavor {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1736457799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1736457799',id=14,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qsXrQessntnV1ggy4TtGhnjE2kFMAm3s1+DIHjlcVYXHL0gF6xHKL7xIdhkF0DlXvm8j+JS6shzfqKN69YtxRTbxo+XLeEdMDeMHhyLn/eHYes9kQEt1YgJ6oZynFVA==',key_name='tempest-keypair-1108949033',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8b28ec62224967ab9679d4761e7e67',ramdisk_id='',reservation_id='r-evruxiqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2107078344',owner_user_name='tempest-TaggedAttachmentsTest-2107078344-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0cc3a0ea394dcf85a7ede8e400faf5',uuid=777f18b7-f03c-449f-ad4b-50ebeb67a38b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] Converting VIF {"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface> {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface>not found in domain: <domain type='kvm' id='19'>
Oct 23 23:07:17 user nova-compute[74482]:   <name>instance-0000000e</name>
Oct 23 23:07:17 user nova-compute[74482]:   <uuid>777f18b7-f03c-449f-ad4b-50ebeb67a38b</uuid>
Oct 23 23:07:17 user nova-compute[74482]:   <metadata>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:07:17 user nova-compute[74482]:   <nova:package version="0.0.0"/>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:name>tempest-device-tagging-server-1736457799</nova:name>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:creationTime>2023-10-23 23:07:16</nova:creationTime>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:flavor name="m1.tiny">
Oct 23 23:07:17 user nova-compute[74482]:     <nova:memory>512</nova:memory>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:disk>1</nova:disk>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:swap>0</nova:swap>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:vcpus>1</nova:vcpus>
Oct 23 23:07:17 user nova-compute[74482]:   </nova:flavor>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:owner>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:user uuid="3a0cc3a0ea394dcf85a7ede8e400faf5">tempest-TaggedAttachmentsTest-2107078344-project-member</nova:user>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:project uuid="2d8b28ec62224967ab9679d4761e7e67">tempest-TaggedAttachmentsTest-2107078344</nova:project>
Oct 23 23:07:17 user nova-compute[74482]:   </nova:owner>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:ports>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:port uuid="d1739e04-cfa4-4e83-bc72-4f508cbfd0df">
Oct 23 23:07:17 user nova-compute[74482]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 23:07:17 user nova-compute[74482]:     </nova:port>
Oct 23 23:07:17 user nova-compute[74482]:   </nova:ports>
Oct 23 23:07:17 user nova-compute[74482]: </nova:instance>
Oct 23 23:07:17 user nova-compute[74482]:   </metadata>
Oct 23 23:07:17 user nova-compute[74482]:   <memory unit='KiB'>524288</memory>
Oct 23 23:07:17 user nova-compute[74482]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 23:07:17 user nova-compute[74482]:   <vcpu placement='static'>1</vcpu>
Oct 23 23:07:17 user nova-compute[74482]:   <resource>
Oct 23 23:07:17 user nova-compute[74482]:     <partition>/machine</partition>
Oct 23 23:07:17 user nova-compute[74482]:   </resource>
Oct 23 23:07:17 user nova-compute[74482]:   <sysinfo type='smbios'>
Oct 23 23:07:17 user nova-compute[74482]:     <system>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='version'>0.0.0</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='serial'>777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='uuid'>777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='family'>Virtual Machine</entry>
Oct 23 23:07:17 user nova-compute[74482]:     </system>
Oct 23 23:07:17 user nova-compute[74482]:   </sysinfo>
Oct 23 23:07:17 user nova-compute[74482]:   <os>
Oct 23 23:07:17 user nova-compute[74482]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 23:07:17 user nova-compute[74482]:     <boot dev='hd'/>
Oct 23 23:07:17 user nova-compute[74482]:     <smbios mode='sysinfo'/>
Oct 23 23:07:17 user nova-compute[74482]:   </os>
Oct 23 23:07:17 user nova-compute[74482]:   <features>
Oct 23 23:07:17 user nova-compute[74482]:     <acpi/>
Oct 23 23:07:17 user nova-compute[74482]:     <apic/>
Oct 23 23:07:17 user nova-compute[74482]:     <vmcoreinfo state='on'/>
Oct 23 23:07:17 user nova-compute[74482]:   </features>
Oct 23 23:07:17 user nova-compute[74482]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 23:07:17 user nova-compute[74482]:     <model fallback='forbid'>Nehalem</model>
Oct 23 23:07:17 user nova-compute[74482]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 23:07:17 user nova-compute[74482]:     <feature policy='require' name='vme'/>
Oct 23 23:07:17 user nova-compute[74482]:     <feature policy='require' name='x2apic'/>
Oct 23 23:07:17 user nova-compute[74482]:     <feature policy='require' name='hypervisor'/>
Oct 23 23:07:17 user nova-compute[74482]:   </cpu>
Oct 23 23:07:17 user nova-compute[74482]:   <clock offset='utc'>
Oct 23 23:07:17 user nova-compute[74482]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 23:07:17 user nova-compute[74482]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 23:07:17 user nova-compute[74482]:     <timer name='hpet' present='no'/>
Oct 23 23:07:17 user nova-compute[74482]:   </clock>
Oct 23 23:07:17 user nova-compute[74482]:   <on_poweroff>destroy</on_poweroff>
Oct 23 23:07:17 user nova-compute[74482]:   <on_reboot>restart</on_reboot>
Oct 23 23:07:17 user nova-compute[74482]:   <on_crash>destroy</on_crash>
Oct 23 23:07:17 user nova-compute[74482]:   <devices>
Oct 23 23:07:17 user nova-compute[74482]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 23:07:17 user nova-compute[74482]:     <disk type='file' device='disk'>
Oct 23 23:07:17 user nova-compute[74482]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 23:07:17 user nova-compute[74482]:       <source file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk' index='2'/>
Oct 23 23:07:17 user nova-compute[74482]:       <backingStore type='file' index='3'>
Oct 23 23:07:17 user nova-compute[74482]:         <format type='raw'/>
Oct 23 23:07:17 user nova-compute[74482]:         <source file='/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae'/>
Oct 23 23:07:17 user nova-compute[74482]:         <backingStore/>
Oct 23 23:07:17 user nova-compute[74482]:       </backingStore>
Oct 23 23:07:17 user nova-compute[74482]:       <target dev='vda' bus='virtio'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='virtio-disk0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </disk>
Oct 23 23:07:17 user nova-compute[74482]:     <disk type='file' device='cdrom'>
Oct 23 23:07:17 user nova-compute[74482]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 23:07:17 user nova-compute[74482]:       <source file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.config' index='1'/>
Oct 23 23:07:17 user nova-compute[74482]:       <backingStore/>
Oct 23 23:07:17 user nova-compute[74482]:       <target dev='hda' bus='ide'/>
Oct 23 23:07:17 user nova-compute[74482]:       <readonly/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='ide0-0-0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </disk>
Oct 23 23:07:17 user nova-compute[74482]:     <controller type='usb' index='0' model='none'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='usb'/>
Oct 23 23:07:17 user nova-compute[74482]:     </controller>
Oct 23 23:07:17 user nova-compute[74482]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='pci.0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </controller>
Oct 23 23:07:17 user nova-compute[74482]:     <controller type='ide' index='0'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='ide'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 23:07:17 user nova-compute[74482]:     </controller>
Oct 23 23:07:17 user nova-compute[74482]:     <interface type='ethernet'>
Oct 23 23:07:17 user nova-compute[74482]:       <mac address='fa:16:3e:f4:d5:ac'/>
Oct 23 23:07:17 user nova-compute[74482]:       <target dev='tapd1739e04-cf'/>
Oct 23 23:07:17 user nova-compute[74482]:       <model type='virtio'/>
Oct 23 23:07:17 user nova-compute[74482]:       <mtu size='1442'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='net0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </interface>
Oct 23 23:07:17 user nova-compute[74482]:     <serial type='pty'>
Oct 23 23:07:17 user nova-compute[74482]:       <source path='/dev/pts/9'/>
Oct 23 23:07:17 user nova-compute[74482]:       <log file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log' append='off'/>
Oct 23 23:07:17 user nova-compute[74482]:       <target type='isa-serial' port='0'>
Oct 23 23:07:17 user nova-compute[74482]:         <model name='isa-serial'/>
Oct 23 23:07:17 user nova-compute[74482]:       </target>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='serial0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </serial>
Oct 23 23:07:17 user nova-compute[74482]:     <console type='pty' tty='/dev/pts/9'>
Oct 23 23:07:17 user nova-compute[74482]:       <source path='/dev/pts/9'/>
Oct 23 23:07:17 user nova-compute[74482]:       <log file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log' append='off'/>
Oct 23 23:07:17 user nova-compute[74482]:       <target type='serial' port='0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='serial0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </console>
Oct 23 23:07:17 user nova-compute[74482]:     <input type='mouse' bus='ps2'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='input0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </input>
Oct 23 23:07:17 user nova-compute[74482]:     <input type='keyboard' bus='ps2'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='input1'/>
Oct 23 23:07:17 user nova-compute[74482]:     </input>
Oct 23 23:07:17 user nova-compute[74482]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 23 23:07:17 user nova-compute[74482]:       <listen type='address' address='0.0.0.0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </graphics>
Oct 23 23:07:17 user nova-compute[74482]:     <audio id='1' type='none'/>
Oct 23 23:07:17 user nova-compute[74482]:     <video>
Oct 23 23:07:17 user nova-compute[74482]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='video0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </video>
Oct 23 23:07:17 user nova-compute[74482]:     <memballoon model='virtio'>
Oct 23 23:07:17 user nova-compute[74482]:       <stats period='10'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='balloon0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </memballoon>
Oct 23 23:07:17 user nova-compute[74482]:     <rng model='virtio'>
Oct 23 23:07:17 user nova-compute[74482]:       <backend model='random'>/dev/urandom</backend>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='rng0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </rng>
Oct 23 23:07:17 user nova-compute[74482]:   </devices>
Oct 23 23:07:17 user nova-compute[74482]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 23:07:17 user nova-compute[74482]:     <label>libvirt-777f18b7-f03c-449f-ad4b-50ebeb67a38b</label>
Oct 23 23:07:17 user nova-compute[74482]:     <imagelabel>libvirt-777f18b7-f03c-449f-ad4b-50ebeb67a38b</imagelabel>
Oct 23 23:07:17 user nova-compute[74482]:   </seclabel>
Oct 23 23:07:17 user nova-compute[74482]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 23:07:17 user nova-compute[74482]:     <label>+64055:+108</label>
Oct 23 23:07:17 user nova-compute[74482]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 23:07:17 user nova-compute[74482]:   </seclabel>
Oct 23 23:07:17 user nova-compute[74482]: </domain>
Oct 23 23:07:17 user nova-compute[74482]:  {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface> {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:f1:3e"/><model type="virtio"/><mtu size="1442"/><target dev="tap9c4c4463-b0"/></interface>not found in domain: <domain type='kvm' id='19'>
Oct 23 23:07:17 user nova-compute[74482]:   <name>instance-0000000e</name>
Oct 23 23:07:17 user nova-compute[74482]:   <uuid>777f18b7-f03c-449f-ad4b-50ebeb67a38b</uuid>
Oct 23 23:07:17 user nova-compute[74482]:   <metadata>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:07:17 user nova-compute[74482]:   <nova:package version="0.0.0"/>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:name>tempest-device-tagging-server-1736457799</nova:name>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:creationTime>2023-10-23 23:07:16</nova:creationTime>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:flavor name="m1.tiny">
Oct 23 23:07:17 user nova-compute[74482]:     <nova:memory>512</nova:memory>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:disk>1</nova:disk>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:swap>0</nova:swap>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:vcpus>1</nova:vcpus>
Oct 23 23:07:17 user nova-compute[74482]:   </nova:flavor>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:owner>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:user uuid="3a0cc3a0ea394dcf85a7ede8e400faf5">tempest-TaggedAttachmentsTest-2107078344-project-member</nova:user>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:project uuid="2d8b28ec62224967ab9679d4761e7e67">tempest-TaggedAttachmentsTest-2107078344</nova:project>
Oct 23 23:07:17 user nova-compute[74482]:   </nova:owner>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:ports>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:port uuid="d1739e04-cfa4-4e83-bc72-4f508cbfd0df">
Oct 23 23:07:17 user nova-compute[74482]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 23:07:17 user nova-compute[74482]:     </nova:port>
Oct 23 23:07:17 user nova-compute[74482]:   </nova:ports>
Oct 23 23:07:17 user nova-compute[74482]: </nova:instance>
Oct 23 23:07:17 user nova-compute[74482]:   </metadata>
Oct 23 23:07:17 user nova-compute[74482]:   <memory unit='KiB'>524288</memory>
Oct 23 23:07:17 user nova-compute[74482]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 23:07:17 user nova-compute[74482]:   <vcpu placement='static'>1</vcpu>
Oct 23 23:07:17 user nova-compute[74482]:   <resource>
Oct 23 23:07:17 user nova-compute[74482]:     <partition>/machine</partition>
Oct 23 23:07:17 user nova-compute[74482]:   </resource>
Oct 23 23:07:17 user nova-compute[74482]:   <sysinfo type='smbios'>
Oct 23 23:07:17 user nova-compute[74482]:     <system>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='version'>0.0.0</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='serial'>777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='uuid'>777f18b7-f03c-449f-ad4b-50ebeb67a38b</entry>
Oct 23 23:07:17 user nova-compute[74482]:       <entry name='family'>Virtual Machine</entry>
Oct 23 23:07:17 user nova-compute[74482]:     </system>
Oct 23 23:07:17 user nova-compute[74482]:   </sysinfo>
Oct 23 23:07:17 user nova-compute[74482]:   <os>
Oct 23 23:07:17 user nova-compute[74482]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 23:07:17 user nova-compute[74482]:     <boot dev='hd'/>
Oct 23 23:07:17 user nova-compute[74482]:     <smbios mode='sysinfo'/>
Oct 23 23:07:17 user nova-compute[74482]:   </os>
Oct 23 23:07:17 user nova-compute[74482]:   <features>
Oct 23 23:07:17 user nova-compute[74482]:     <acpi/>
Oct 23 23:07:17 user nova-compute[74482]:     <apic/>
Oct 23 23:07:17 user nova-compute[74482]:     <vmcoreinfo state='on'/>
Oct 23 23:07:17 user nova-compute[74482]:   </features>
Oct 23 23:07:17 user nova-compute[74482]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 23:07:17 user nova-compute[74482]:     <model fallback='forbid'>Nehalem</model>
Oct 23 23:07:17 user nova-compute[74482]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 23:07:17 user nova-compute[74482]:     <feature policy='require' name='vme'/>
Oct 23 23:07:17 user nova-compute[74482]:     <feature policy='require' name='x2apic'/>
Oct 23 23:07:17 user nova-compute[74482]:     <feature policy='require' name='hypervisor'/>
Oct 23 23:07:17 user nova-compute[74482]:   </cpu>
Oct 23 23:07:17 user nova-compute[74482]:   <clock offset='utc'>
Oct 23 23:07:17 user nova-compute[74482]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 23:07:17 user nova-compute[74482]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 23:07:17 user nova-compute[74482]:     <timer name='hpet' present='no'/>
Oct 23 23:07:17 user nova-compute[74482]:   </clock>
Oct 23 23:07:17 user nova-compute[74482]:   <on_poweroff>destroy</on_poweroff>
Oct 23 23:07:17 user nova-compute[74482]:   <on_reboot>restart</on_reboot>
Oct 23 23:07:17 user nova-compute[74482]:   <on_crash>destroy</on_crash>
Oct 23 23:07:17 user nova-compute[74482]:   <devices>
Oct 23 23:07:17 user nova-compute[74482]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 23:07:17 user nova-compute[74482]:     <disk type='file' device='disk'>
Oct 23 23:07:17 user nova-compute[74482]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 23:07:17 user nova-compute[74482]:       <source file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk' index='2'/>
Oct 23 23:07:17 user nova-compute[74482]:       <backingStore type='file' index='3'>
Oct 23 23:07:17 user nova-compute[74482]:         <format type='raw'/>
Oct 23 23:07:17 user nova-compute[74482]:         <source file='/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae'/>
Oct 23 23:07:17 user nova-compute[74482]:         <backingStore/>
Oct 23 23:07:17 user nova-compute[74482]:       </backingStore>
Oct 23 23:07:17 user nova-compute[74482]:       <target dev='vda' bus='virtio'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='virtio-disk0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </disk>
Oct 23 23:07:17 user nova-compute[74482]:     <disk type='file' device='cdrom'>
Oct 23 23:07:17 user nova-compute[74482]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 23:07:17 user nova-compute[74482]:       <source file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk.config' index='1'/>
Oct 23 23:07:17 user nova-compute[74482]:       <backingStore/>
Oct 23 23:07:17 user nova-compute[74482]:       <target dev='hda' bus='ide'/>
Oct 23 23:07:17 user nova-compute[74482]:       <readonly/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='ide0-0-0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </disk>
Oct 23 23:07:17 user nova-compute[74482]:     <controller type='usb' index='0' model='none'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='usb'/>
Oct 23 23:07:17 user nova-compute[74482]:     </controller>
Oct 23 23:07:17 user nova-compute[74482]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='pci.0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </controller>
Oct 23 23:07:17 user nova-compute[74482]:     <controller type='ide' index='0'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='ide'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 23:07:17 user nova-compute[74482]:     </controller>
Oct 23 23:07:17 user nova-compute[74482]:     <interface type='ethernet'>
Oct 23 23:07:17 user nova-compute[74482]:       <mac address='fa:16:3e:f4:d5:ac'/>
Oct 23 23:07:17 user nova-compute[74482]:       <target dev='tapd1739e04-cf'/>
Oct 23 23:07:17 user nova-compute[74482]:       <model type='virtio'/>
Oct 23 23:07:17 user nova-compute[74482]:       <mtu size='1442'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='net0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </interface>
Oct 23 23:07:17 user nova-compute[74482]:     <serial type='pty'>
Oct 23 23:07:17 user nova-compute[74482]:       <source path='/dev/pts/9'/>
Oct 23 23:07:17 user nova-compute[74482]:       <log file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log' append='off'/>
Oct 23 23:07:17 user nova-compute[74482]:       <target type='isa-serial' port='0'>
Oct 23 23:07:17 user nova-compute[74482]:         <model name='isa-serial'/>
Oct 23 23:07:17 user nova-compute[74482]:       </target>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='serial0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </serial>
Oct 23 23:07:17 user nova-compute[74482]:     <console type='pty' tty='/dev/pts/9'>
Oct 23 23:07:17 user nova-compute[74482]:       <source path='/dev/pts/9'/>
Oct 23 23:07:17 user nova-compute[74482]:       <log file='/opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/console.log' append='off'/>
Oct 23 23:07:17 user nova-compute[74482]:       <target type='serial' port='0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='serial0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </console>
Oct 23 23:07:17 user nova-compute[74482]:     <input type='mouse' bus='ps2'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='input0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </input>
Oct 23 23:07:17 user nova-compute[74482]:     <input type='keyboard' bus='ps2'>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='input1'/>
Oct 23 23:07:17 user nova-compute[74482]:     </input>
Oct 23 23:07:17 user nova-compute[74482]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 23 23:07:17 user nova-compute[74482]:       <listen type='address' address='0.0.0.0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </graphics>
Oct 23 23:07:17 user nova-compute[74482]:     <audio id='1' type='none'/>
Oct 23 23:07:17 user nova-compute[74482]:     <video>
Oct 23 23:07:17 user nova-compute[74482]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='video0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </video>
Oct 23 23:07:17 user nova-compute[74482]:     <memballoon model='virtio'>
Oct 23 23:07:17 user nova-compute[74482]:       <stats period='10'/>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='balloon0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </memballoon>
Oct 23 23:07:17 user nova-compute[74482]:     <rng model='virtio'>
Oct 23 23:07:17 user nova-compute[74482]:       <backend model='random'>/dev/urandom</backend>
Oct 23 23:07:17 user nova-compute[74482]:       <alias name='rng0'/>
Oct 23 23:07:17 user nova-compute[74482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 23:07:17 user nova-compute[74482]:     </rng>
Oct 23 23:07:17 user nova-compute[74482]:   </devices>
Oct 23 23:07:17 user nova-compute[74482]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 23:07:17 user nova-compute[74482]:     <label>libvirt-777f18b7-f03c-449f-ad4b-50ebeb67a38b</label>
Oct 23 23:07:17 user nova-compute[74482]:     <imagelabel>libvirt-777f18b7-f03c-449f-ad4b-50ebeb67a38b</imagelabel>
Oct 23 23:07:17 user nova-compute[74482]:   </seclabel>
Oct 23 23:07:17 user nova-compute[74482]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 23:07:17 user nova-compute[74482]:     <label>+64055:+108</label>
Oct 23 23:07:17 user nova-compute[74482]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 23:07:17 user nova-compute[74482]:   </seclabel>
Oct 23 23:07:17 user nova-compute[74482]: </domain>
Oct 23 23:07:17 user nova-compute[74482]:  {{(pid=74482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 23:07:17 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Detaching interface fa:16:3e:9e:f1:3e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap9c4c4463-b0' not found.
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1736457799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1736457799',id=14,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qsXrQessntnV1ggy4TtGhnjE2kFMAm3s1+DIHjlcVYXHL0gF6xHKL7xIdhkF0DlXvm8j+JS6shzfqKN69YtxRTbxo+XLeEdMDeMHhyLn/eHYes9kQEt1YgJ6oZynFVA==',key_name='tempest-keypair-1108949033',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8b28ec62224967ab9679d4761e7e67',ramdisk_id='',reservation_id='r-evruxiqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2107078344',owner_user_name='tempest-TaggedAttachmentsTest-2107078344-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0cc3a0ea394dcf85a7ede8e400faf5',uuid=777f18b7-f03c-449f-ad4b-50ebeb67a38b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] Converting VIF {"id": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "address": "fa:16:3e:9e:f1:3e", "network": {"id": "f92487df-a9b7-49d0-98b3-a80d2a7922ad", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-797484073", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.26", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4c4463-b0", "ovs_interfaceid": "9c4c4463-b0e7-4bab-8353-6518fa71af9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG os_vif [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c4c4463-b0, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:07:17 user nova-compute[74482]: INFO os_vif [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:f1:3e,bridge_name='br-int',has_traffic_filtering=True,id=9c4c4463-b0e7-4bab-8353-6518fa71af9b,network=Network(f92487df-a9b7-49d0-98b3-a80d2a7922ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4c4463-b0')
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [req-71ecf483-909f-4a22-9cc0-dd83bfac16c5 req-2b4d56f1-afd1-48a7-a9ac-1c2bd36611ea service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:07:17 user nova-compute[74482]:   <nova:package version="0.0.0"/>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:name>tempest-device-tagging-server-1736457799</nova:name>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:creationTime>2023-10-23 23:07:17</nova:creationTime>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:flavor name="m1.tiny">
Oct 23 23:07:17 user nova-compute[74482]:     <nova:memory>512</nova:memory>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:disk>1</nova:disk>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:swap>0</nova:swap>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:vcpus>1</nova:vcpus>
Oct 23 23:07:17 user nova-compute[74482]:   </nova:flavor>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:owner>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:user uuid="3a0cc3a0ea394dcf85a7ede8e400faf5">tempest-TaggedAttachmentsTest-2107078344-project-member</nova:user>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:project uuid="2d8b28ec62224967ab9679d4761e7e67">tempest-TaggedAttachmentsTest-2107078344</nova:project>
Oct 23 23:07:17 user nova-compute[74482]:   </nova:owner>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:07:17 user nova-compute[74482]:   <nova:ports>
Oct 23 23:07:17 user nova-compute[74482]:     <nova:port uuid="d1739e04-cfa4-4e83-bc72-4f508cbfd0df">
Oct 23 23:07:17 user nova-compute[74482]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 23:07:17 user nova-compute[74482]:     </nova:port>
Oct 23 23:07:17 user nova-compute[74482]:   </nova:ports>
Oct 23 23:07:17 user nova-compute[74482]: </nova:instance>
Oct 23 23:07:17 user nova-compute[74482]:  {{(pid=74482) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating instance_info_cache with network_info: [{"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Releasing lock "refresh_cache-777f18b7-f03c-449f-ad4b-50ebeb67a38b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:07:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-85276f23-abb5-42a2-975a-189ef155adb8 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "interface-777f18b7-f03c-449f-ad4b-50ebeb67a38b-9c4c4463-b0e7-4bab-8353-6518fa71af9b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.347s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:07:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:07:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:07:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:07:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:07:18 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid fc2566c6-8911-425b-b05d-a008e67a9d34 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updating instance_info_cache with network_info: [{"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:07:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.147384643554688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa063829-b117-40f4-93f2-358b33f1d156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 1718ea62-105b-44ac-80f6-587224314449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:07:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:07:24 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:07:24 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:07:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:07:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:07:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:07:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:07:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:07:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:45 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:07:45 user nova-compute[74482]: INFO nova.compute.claims [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Claim successful on node user
Oct 23 23:07:46 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:07:46 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:07:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG nova.policy [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebd17d342e7145e0bad04188ec8be780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981f084ec65e4fa0a9cbd2e5edf8302a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:07:46 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Creating image(s)
Oct 23 23:07:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "/opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "/opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "/opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.221s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk 1073741824" returned: 0 in 0.059s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Successfully created port: e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Cannot resize image /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Ensure instance console log exists: /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:47 user nova-compute[74482]: INFO nova.compute.manager [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Terminating instance
Oct 23 23:07:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-2983005f-7417-442c-9099-b6c2c069e476 req-80b0c732-acb5-4f60-9429-f415625cf012 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-unplugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2983005f-7417-442c-9099-b6c2c069e476 req-80b0c732-acb5-4f60-9429-f415625cf012 service nova] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2983005f-7417-442c-9099-b6c2c069e476 req-80b0c732-acb5-4f60-9429-f415625cf012 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2983005f-7417-442c-9099-b6c2c069e476 req-80b0c732-acb5-4f60-9429-f415625cf012 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-2983005f-7417-442c-9099-b6c2c069e476 req-80b0c732-acb5-4f60-9429-f415625cf012 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] No waiting events found dispatching network-vif-unplugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:07:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-2983005f-7417-442c-9099-b6c2c069e476 req-80b0c732-acb5-4f60-9429-f415625cf012 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-unplugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Successfully updated port: e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "refresh_cache-a18c958b-f7d9-47ba-ad98-332e12838d81" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquired lock "refresh_cache-a18c958b-f7d9-47ba-ad98-332e12838d81" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-ffad4197-ed84-421c-bc03-ce8a6585c7dd req-930359e4-398f-4718-8f02-372a46ccd31b service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-changed-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-ffad4197-ed84-421c-bc03-ce8a6585c7dd req-930359e4-398f-4718-8f02-372a46ccd31b service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Refreshing instance network info cache due to event network-changed-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ffad4197-ed84-421c-bc03-ce8a6585c7dd req-930359e4-398f-4718-8f02-372a46ccd31b service nova] Acquiring lock "refresh_cache-a18c958b-f7d9-47ba-ad98-332e12838d81" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:07:48 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Instance destroyed successfully.
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.objects.instance [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lazy-loading 'resources' on Instance uuid 777f18b7-f03c-449f-ad4b-50ebeb67a38b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1736457799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1736457799',id=14,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0qsXrQessntnV1ggy4TtGhnjE2kFMAm3s1+DIHjlcVYXHL0gF6xHKL7xIdhkF0DlXvm8j+JS6shzfqKN69YtxRTbxo+XLeEdMDeMHhyLn/eHYes9kQEt1YgJ6oZynFVA==',key_name='tempest-keypair-1108949033',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8b28ec62224967ab9679d4761e7e67',ramdisk_id='',reservation_id='r-evruxiqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2107078344',owner_user_name='tempest-TaggedAttachmentsTest-2107078344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a0cc3a0ea394dcf85a7ede8e400faf5',uuid=777f18b7-f03c-449f-ad4b-50ebeb67a38b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converting VIF {"id": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "address": "fa:16:3e:f4:d5:ac", "network": {"id": "f94545b6-b13f-4b55-b05b-3dbca149f956", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-805212703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8b28ec62224967ab9679d4761e7e67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1739e04-cf", "ovs_interfaceid": "d1739e04-cfa4-4e83-bc72-4f508cbfd0df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1739e04-cfa4-4e83-bc72-4f508cbfd0df,network=Network(f94545b6-b13f-4b55-b05b-3dbca149f956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1739e04-cf') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG os_vif [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1739e04-cfa4-4e83-bc72-4f508cbfd0df,network=Network(f94545b6-b13f-4b55-b05b-3dbca149f956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1739e04-cf') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1739e04-cf, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7173116-b4cb-45d3-8bdd-80ebc82c8158) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: INFO os_vif [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:d5:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1739e04-cfa4-4e83-bc72-4f508cbfd0df,network=Network(f94545b6-b13f-4b55-b05b-3dbca149f956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1739e04-cf')
Oct 23 23:07:48 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Deleting instance files /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b_del
Oct 23 23:07:48 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Deletion of /opt/stack/data/nova/instances/777f18b7-f03c-449f-ad4b-50ebeb67a38b_del complete
Oct 23 23:07:48 user nova-compute[74482]: INFO nova.compute.manager [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 23 23:07:48 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Updating instance_info_cache with network_info: [{"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Releasing lock "refresh_cache-a18c958b-f7d9-47ba-ad98-332e12838d81" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Instance network_info: |[{"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ffad4197-ed84-421c-bc03-ce8a6585c7dd req-930359e4-398f-4718-8f02-372a46ccd31b service nova] Acquired lock "refresh_cache-a18c958b-f7d9-47ba-ad98-332e12838d81" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-ffad4197-ed84-421c-bc03-ce8a6585c7dd req-930359e4-398f-4718-8f02-372a46ccd31b service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Refreshing network info cache for port e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Start _get_guest_xml network_info=[{"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:07:48 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:07:48 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1398952637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1398952637',id=18,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-ddzzzov1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:07:47Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=a18c958b-f7d9-47ba-ad98-332e12838d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:14:ea,bridge_name='br-int',has_traffic_filtering=True,id=e9d311a7-9a4f-439c-ace1-ed6ac41bd86d,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d311a7-9a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.objects.instance [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'pci_devices' on Instance uuid a18c958b-f7d9-47ba-ad98-332e12838d81 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:07:48 user nova-compute[74482]:   <uuid>a18c958b-f7d9-47ba-ad98-332e12838d81</uuid>
Oct 23 23:07:48 user nova-compute[74482]:   <name>instance-00000012</name>
Oct 23 23:07:48 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:07:48 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:07:48 user nova-compute[74482]:   <metadata>
Oct 23 23:07:48 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:07:48 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:07:48 user nova-compute[74482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1398952637</nova:name>
Oct 23 23:07:48 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:07:48</nova:creationTime>
Oct 23 23:07:48 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:07:48 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:07:48 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:07:48 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:07:48 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:07:48 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:07:48 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:07:48 user nova-compute[74482]:       <nova:owner>
Oct 23 23:07:48 user nova-compute[74482]:         <nova:user uuid="ebd17d342e7145e0bad04188ec8be780">tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member</nova:user>
Oct 23 23:07:48 user nova-compute[74482]:         <nova:project uuid="981f084ec65e4fa0a9cbd2e5edf8302a">tempest-ServerBootFromVolumeStableRescueTest-157113739</nova:project>
Oct 23 23:07:48 user nova-compute[74482]:       </nova:owner>
Oct 23 23:07:48 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:07:48 user nova-compute[74482]:       <nova:ports>
Oct 23 23:07:48 user nova-compute[74482]:         <nova:port uuid="e9d311a7-9a4f-439c-ace1-ed6ac41bd86d">
Oct 23 23:07:48 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 23:07:48 user nova-compute[74482]:         </nova:port>
Oct 23 23:07:48 user nova-compute[74482]:       </nova:ports>
Oct 23 23:07:48 user nova-compute[74482]:     </nova:instance>
Oct 23 23:07:48 user nova-compute[74482]:   </metadata>
Oct 23 23:07:48 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:07:48 user nova-compute[74482]:     <system>
Oct 23 23:07:48 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:07:48 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:07:48 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:07:48 user nova-compute[74482]:       <entry name="serial">a18c958b-f7d9-47ba-ad98-332e12838d81</entry>
Oct 23 23:07:48 user nova-compute[74482]:       <entry name="uuid">a18c958b-f7d9-47ba-ad98-332e12838d81</entry>
Oct 23 23:07:48 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:07:48 user nova-compute[74482]:     </system>
Oct 23 23:07:48 user nova-compute[74482]:   </sysinfo>
Oct 23 23:07:48 user nova-compute[74482]:   <os>
Oct 23 23:07:48 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:07:48 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:07:48 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:07:48 user nova-compute[74482]:   </os>
Oct 23 23:07:48 user nova-compute[74482]:   <features>
Oct 23 23:07:48 user nova-compute[74482]:     <acpi/>
Oct 23 23:07:48 user nova-compute[74482]:     <apic/>
Oct 23 23:07:48 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:07:48 user nova-compute[74482]:   </features>
Oct 23 23:07:48 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:07:48 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:07:48 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:07:48 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:07:48 user nova-compute[74482]:   </clock>
Oct 23 23:07:48 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:07:48 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:07:48 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:07:48 user nova-compute[74482]:   </cpu>
Oct 23 23:07:48 user nova-compute[74482]:   <devices>
Oct 23 23:07:48 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:07:48 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:07:48 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk"/>
Oct 23 23:07:48 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:07:48 user nova-compute[74482]:     </disk>
Oct 23 23:07:48 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:07:48 user nova-compute[74482]:       <mac address="fa:16:3e:b1:14:ea"/>
Oct 23 23:07:48 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:07:48 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:07:48 user nova-compute[74482]:       <target dev="tape9d311a7-9a"/>
Oct 23 23:07:48 user nova-compute[74482]:     </interface>
Oct 23 23:07:48 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:07:48 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/console.log" append="off"/>
Oct 23 23:07:48 user nova-compute[74482]:     </serial>
Oct 23 23:07:48 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:07:48 user nova-compute[74482]:     <video>
Oct 23 23:07:48 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:07:48 user nova-compute[74482]:     </video>
Oct 23 23:07:48 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:07:48 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:07:48 user nova-compute[74482]:     </rng>
Oct 23 23:07:48 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:07:48 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:07:48 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:07:48 user nova-compute[74482]:     </memballoon>
Oct 23 23:07:48 user nova-compute[74482]:   </devices>
Oct 23 23:07:48 user nova-compute[74482]: </domain>
Oct 23 23:07:48 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1398952637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1398952637',id=18,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-ddzzzov1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:07:47Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=a18c958b-f7d9-47ba-ad98-332e12838d81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:14:ea,bridge_name='br-int',has_traffic_filtering=True,id=e9d311a7-9a4f-439c-ace1-ed6ac41bd86d,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d311a7-9a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG os_vif [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:14:ea,bridge_name='br-int',has_traffic_filtering=True,id=e9d311a7-9a4f-439c-ace1-ed6ac41bd86d,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d311a7-9a') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80e18b28-d744-58d9-afcf-b6322ecccb96', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9d311a7-9a, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9d311a7-9a, col_values=(('qos', UUID('f52644a7-f560-41d1-9de2-8b45e1bd9d46')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9d311a7-9a, col_values=(('external_ids', {'iface-id': 'e9d311a7-9a4f-439c-ace1-ed6ac41bd86d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:14:ea', 'vm-uuid': 'a18c958b-f7d9-47ba-ad98-332e12838d81'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:48 user nova-compute[74482]: INFO os_vif [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:14:ea,bridge_name='br-int',has_traffic_filtering=True,id=e9d311a7-9a4f-439c-ace1-ed6ac41bd86d,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d311a7-9a')
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:07:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No VIF found with MAC fa:16:3e:b1:14:ea, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG nova.network.neutron [req-ffad4197-ed84-421c-bc03-ce8a6585c7dd req-930359e4-398f-4718-8f02-372a46ccd31b service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Updated VIF entry in instance network info cache for port e9d311a7-9a4f-439c-ace1-ed6ac41bd86d. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG nova.network.neutron [req-ffad4197-ed84-421c-bc03-ce8a6585c7dd req-930359e4-398f-4718-8f02-372a46ccd31b service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Updating instance_info_cache with network_info: [{"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ffad4197-ed84-421c-bc03-ce8a6585c7dd req-930359e4-398f-4718-8f02-372a46ccd31b service nova] Releasing lock "refresh_cache-a18c958b-f7d9-47ba-ad98-332e12838d81" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-7b397542-8599-4b08-b56a-2e8934451349 req-7b7869d0-a3d1-4b5a-aefb-85c7d3dc426b service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-deleted-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:49 user nova-compute[74482]: INFO nova.compute.manager [req-7b397542-8599-4b08-b56a-2e8934451349 req-7b7869d0-a3d1-4b5a-aefb-85c7d3dc426b service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Neutron deleted interface d1739e04-cfa4-4e83-bc72-4f508cbfd0df; detaching it from the instance and deleting it from the info cache
Oct 23 23:07:49 user nova-compute[74482]: DEBUG nova.network.neutron [req-7b397542-8599-4b08-b56a-2e8934451349 req-7b7869d0-a3d1-4b5a-aefb-85c7d3dc426b service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:07:49 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Took 1.22 seconds to deallocate network for instance.
Oct 23 23:07:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-7b397542-8599-4b08-b56a-2e8934451349 req-7b7869d0-a3d1-4b5a-aefb-85c7d3dc426b service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Detach interface failed, port_id=d1739e04-cfa4-4e83-bc72-4f508cbfd0df, reason: Instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-859c1c8c-ecf7-4be0-a7e7-6e7225fda342 req-292ceb38-b93e-43a0-98ec-4b94e74d78d3 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received event network-vif-plugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-859c1c8c-ecf7-4be0-a7e7-6e7225fda342 req-292ceb38-b93e-43a0-98ec-4b94e74d78d3 service nova] Acquiring lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-859c1c8c-ecf7-4be0-a7e7-6e7225fda342 req-292ceb38-b93e-43a0-98ec-4b94e74d78d3 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-859c1c8c-ecf7-4be0-a7e7-6e7225fda342 req-292ceb38-b93e-43a0-98ec-4b94e74d78d3 service nova] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-859c1c8c-ecf7-4be0-a7e7-6e7225fda342 req-292ceb38-b93e-43a0-98ec-4b94e74d78d3 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] No waiting events found dispatching network-vif-plugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:07:49 user nova-compute[74482]: WARNING nova.compute.manager [req-859c1c8c-ecf7-4be0-a7e7-6e7225fda342 req-292ceb38-b93e-43a0-98ec-4b94e74d78d3 service nova] [instance: 777f18b7-f03c-449f-ad4b-50ebeb67a38b] Received unexpected event network-vif-plugged-d1739e04-cfa4-4e83-bc72-4f508cbfd0df for instance with vm_state deleted and task_state None.
Oct 23 23:07:50 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:50 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Deleted allocations for instance 777f18b7-f03c-449f-ad4b-50ebeb67a38b
Oct 23 23:07:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfce0e5-f24d-42c1-b311-8d6b1a98dc08 tempest-TaggedAttachmentsTest-2107078344 tempest-TaggedAttachmentsTest-2107078344-project-member] Lock "777f18b7-f03c-449f-ad4b-50ebeb67a38b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.833s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-870186a5-ee0b-4e58-bb9d-82b1bba1c364 req-c2b574b6-6532-4d4f-beee-982bed4f3d40 service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-870186a5-ee0b-4e58-bb9d-82b1bba1c364 req-c2b574b6-6532-4d4f-beee-982bed4f3d40 service nova] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-870186a5-ee0b-4e58-bb9d-82b1bba1c364 req-c2b574b6-6532-4d4f-beee-982bed4f3d40 service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-870186a5-ee0b-4e58-bb9d-82b1bba1c364 req-c2b574b6-6532-4d4f-beee-982bed4f3d40 service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-870186a5-ee0b-4e58-bb9d-82b1bba1c364 req-c2b574b6-6532-4d4f-beee-982bed4f3d40 service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] No waiting events found dispatching network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:07:50 user nova-compute[74482]: WARNING nova.compute.manager [req-870186a5-ee0b-4e58-bb9d-82b1bba1c364 req-c2b574b6-6532-4d4f-beee-982bed4f3d40 service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received unexpected event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d for instance with vm_state building and task_state spawning.
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:07:52 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Instance spawned successfully.
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:07:52 user nova-compute[74482]: INFO nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Took 5.95 seconds to spawn the instance on the hypervisor.
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-32b47c36-75bb-4802-8dcc-50ca4d57f859 req-553d0eb3-1765-45c6-af46-cd475a47b030 service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-32b47c36-75bb-4802-8dcc-50ca4d57f859 req-553d0eb3-1765-45c6-af46-cd475a47b030 service nova] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-32b47c36-75bb-4802-8dcc-50ca4d57f859 req-553d0eb3-1765-45c6-af46-cd475a47b030 service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-32b47c36-75bb-4802-8dcc-50ca4d57f859 req-553d0eb3-1765-45c6-af46-cd475a47b030 service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-32b47c36-75bb-4802-8dcc-50ca4d57f859 req-553d0eb3-1765-45c6-af46-cd475a47b030 service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] No waiting events found dispatching network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:07:52 user nova-compute[74482]: WARNING nova.compute.manager [req-32b47c36-75bb-4802-8dcc-50ca4d57f859 req-553d0eb3-1765-45c6-af46-cd475a47b030 service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received unexpected event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d for instance with vm_state building and task_state spawning.
Oct 23 23:07:52 user nova-compute[74482]: INFO nova.compute.manager [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Took 6.83 seconds to build instance.
Oct 23 23:07:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b7e45b56-22bc-437f-adee-69f8af57b20b tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.986s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:07:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-96d99bc5-772c-4b69-964f-d7e6aeeb6804 req-24af6db3-af36-4eb3-ba6b-efbb3932b32b service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received event network-changed-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:07:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-96d99bc5-772c-4b69-964f-d7e6aeeb6804 req-24af6db3-af36-4eb3-ba6b-efbb3932b32b service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Refreshing instance network info cache due to event network-changed-4c31b56e-df70-475c-a0fc-7c5c1be07e26. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:07:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-96d99bc5-772c-4b69-964f-d7e6aeeb6804 req-24af6db3-af36-4eb3-ba6b-efbb3932b32b service nova] Acquiring lock "refresh_cache-1718ea62-105b-44ac-80f6-587224314449" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:07:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-96d99bc5-772c-4b69-964f-d7e6aeeb6804 req-24af6db3-af36-4eb3-ba6b-efbb3932b32b service nova] Acquired lock "refresh_cache-1718ea62-105b-44ac-80f6-587224314449" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:07:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-96d99bc5-772c-4b69-964f-d7e6aeeb6804 req-24af6db3-af36-4eb3-ba6b-efbb3932b32b service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Refreshing network info cache for port 4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:07:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-96d99bc5-772c-4b69-964f-d7e6aeeb6804 req-24af6db3-af36-4eb3-ba6b-efbb3932b32b service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Updated VIF entry in instance network info cache for port 4c31b56e-df70-475c-a0fc-7c5c1be07e26. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:07:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-96d99bc5-772c-4b69-964f-d7e6aeeb6804 req-24af6db3-af36-4eb3-ba6b-efbb3932b32b service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Updating instance_info_cache with network_info: [{"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:07:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-96d99bc5-772c-4b69-964f-d7e6aeeb6804 req-24af6db3-af36-4eb3-ba6b-efbb3932b32b service nova] Releasing lock "refresh_cache-1718ea62-105b-44ac-80f6-587224314449" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:07:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:07:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:07:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:07:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:08:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:08:00 user nova-compute[74482]: INFO nova.compute.claims [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Claim successful on node user
Oct 23 23:08:00 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:08:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:08:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:08:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:08:00 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:08:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:08:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:08:00 user nova-compute[74482]: DEBUG nova.policy [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dfe9260c1b8446fbcda07a9dcfa65fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c07328e2befa472d804361a59ac16829', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:08:01 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Creating image(s)
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.226s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG nova.objects.instance [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lazy-loading 'flavor' on Instance uuid 1718ea62-105b-44ac-80f6-587224314449 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.212s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk 1073741824" returned: 0 in 0.074s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:01 user nova-compute[74482]: INFO nova.compute.manager [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Attaching volume 204c3abb-1574-44f9-912f-69a44333b916 to /dev/vdb
Oct 23 23:08:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Successfully created port: e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG os_brick.utils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.234s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb9e74b-0717-45e8-8534-86f18f470304]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9560be-32ae-48e8-bb3f-8686ab088094]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e753cdf-6984-4b39-830c-60a97beba834]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2def018-6abe-4806-bf4e-0a009e2d7635]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:08:01 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:08:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50805206-2ac8-4d8c-82a9-b627c7e30606]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG os_brick.utils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] <== get_connector_properties: return (212ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:08:01 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Updating existing volume attachment record: 527d783d-88f4-4ba4-9372-4d3d035bf5b7 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Cannot resize image /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Ensure instance console log exists: /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Successfully updated port: e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquired lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-01de5469-007e-43ba-a919-7ef00972bb7f req-c61d69d9-3563-42e3-b783-e7ea1f693d0f service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-changed-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-01de5469-007e-43ba-a919-7ef00972bb7f req-c61d69d9-3563-42e3-b783-e7ea1f693d0f service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Refreshing instance network info cache due to event network-changed-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-01de5469-007e-43ba-a919-7ef00972bb7f req-c61d69d9-3563-42e3-b783-e7ea1f693d0f service nova] Acquiring lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updating instance_info_cache with network_info: [{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Releasing lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Instance network_info: |[{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-01de5469-007e-43ba-a919-7ef00972bb7f req-c61d69d9-3563-42e3-b783-e7ea1f693d0f service nova] Acquired lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-01de5469-007e-43ba-a919-7ef00972bb7f req-c61d69d9-3563-42e3-b783-e7ea1f693d0f service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Refreshing network info cache for port e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:08:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Start _get_guest_xml network_info=[{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:08:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:08:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1964417688',display_name='tempest-ServerRescueNegativeTestJSON-server-1964417688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1964417688',id=19,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT8VqUMB8rnh10l+ySFNmiC2m4ZblMqqwo0Xr/8hHga0olsqbmgYn1OrZ6ijsuJti0TkZOcVMOb7g9Pg4J6If3LXbS2hyryUQidVH8jZIQprpVD549e3rW+HR7Pt7DDSA==',key_name='tempest-keypair-20632901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-8d8965bs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:08:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=03e1e9cb-0954-444f-baf5-cb2e2acd4b3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:84:96,bridge_name='br-int',has_traffic_filtering=True,id=e28ce78b-2583-4ef4-a071-d3b25fc5a3ea,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28ce78b-25') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'pci_devices' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:08:03 user nova-compute[74482]:   <uuid>03e1e9cb-0954-444f-baf5-cb2e2acd4b3b</uuid>
Oct 23 23:08:03 user nova-compute[74482]:   <name>instance-00000013</name>
Oct 23 23:08:03 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:08:03 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:08:03 user nova-compute[74482]:   <metadata>
Oct 23 23:08:03 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:08:03 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:08:03 user nova-compute[74482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1964417688</nova:name>
Oct 23 23:08:03 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:08:03</nova:creationTime>
Oct 23 23:08:03 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:08:03 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:08:03 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:08:03 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:08:03 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:08:03 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:08:03 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:08:03 user nova-compute[74482]:       <nova:owner>
Oct 23 23:08:03 user nova-compute[74482]:         <nova:user uuid="2dfe9260c1b8446fbcda07a9dcfa65fb">tempest-ServerRescueNegativeTestJSON-1888569284-project-member</nova:user>
Oct 23 23:08:03 user nova-compute[74482]:         <nova:project uuid="c07328e2befa472d804361a59ac16829">tempest-ServerRescueNegativeTestJSON-1888569284</nova:project>
Oct 23 23:08:03 user nova-compute[74482]:       </nova:owner>
Oct 23 23:08:03 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:08:03 user nova-compute[74482]:       <nova:ports>
Oct 23 23:08:03 user nova-compute[74482]:         <nova:port uuid="e28ce78b-2583-4ef4-a071-d3b25fc5a3ea">
Oct 23 23:08:03 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 23:08:03 user nova-compute[74482]:         </nova:port>
Oct 23 23:08:03 user nova-compute[74482]:       </nova:ports>
Oct 23 23:08:03 user nova-compute[74482]:     </nova:instance>
Oct 23 23:08:03 user nova-compute[74482]:   </metadata>
Oct 23 23:08:03 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:08:03 user nova-compute[74482]:     <system>
Oct 23 23:08:03 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:08:03 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:08:03 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:08:03 user nova-compute[74482]:       <entry name="serial">03e1e9cb-0954-444f-baf5-cb2e2acd4b3b</entry>
Oct 23 23:08:03 user nova-compute[74482]:       <entry name="uuid">03e1e9cb-0954-444f-baf5-cb2e2acd4b3b</entry>
Oct 23 23:08:03 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:08:03 user nova-compute[74482]:     </system>
Oct 23 23:08:03 user nova-compute[74482]:   </sysinfo>
Oct 23 23:08:03 user nova-compute[74482]:   <os>
Oct 23 23:08:03 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:08:03 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:08:03 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:08:03 user nova-compute[74482]:   </os>
Oct 23 23:08:03 user nova-compute[74482]:   <features>
Oct 23 23:08:03 user nova-compute[74482]:     <acpi/>
Oct 23 23:08:03 user nova-compute[74482]:     <apic/>
Oct 23 23:08:03 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:08:03 user nova-compute[74482]:   </features>
Oct 23 23:08:03 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:08:03 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:08:03 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:08:03 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:08:03 user nova-compute[74482]:   </clock>
Oct 23 23:08:03 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:08:03 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:08:03 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:08:03 user nova-compute[74482]:   </cpu>
Oct 23 23:08:03 user nova-compute[74482]:   <devices>
Oct 23 23:08:03 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:08:03 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:08:03 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk"/>
Oct 23 23:08:03 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:08:03 user nova-compute[74482]:     </disk>
Oct 23 23:08:03 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:08:03 user nova-compute[74482]:       <mac address="fa:16:3e:1b:84:96"/>
Oct 23 23:08:03 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:08:03 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:08:03 user nova-compute[74482]:       <target dev="tape28ce78b-25"/>
Oct 23 23:08:03 user nova-compute[74482]:     </interface>
Oct 23 23:08:03 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:08:03 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/console.log" append="off"/>
Oct 23 23:08:03 user nova-compute[74482]:     </serial>
Oct 23 23:08:03 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:08:03 user nova-compute[74482]:     <video>
Oct 23 23:08:03 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:08:03 user nova-compute[74482]:     </video>
Oct 23 23:08:03 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:08:03 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:08:03 user nova-compute[74482]:     </rng>
Oct 23 23:08:03 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:08:03 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:08:03 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:08:03 user nova-compute[74482]:     </memballoon>
Oct 23 23:08:03 user nova-compute[74482]:   </devices>
Oct 23 23:08:03 user nova-compute[74482]: </domain>
Oct 23 23:08:03 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1964417688',display_name='tempest-ServerRescueNegativeTestJSON-server-1964417688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1964417688',id=19,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT8VqUMB8rnh10l+ySFNmiC2m4ZblMqqwo0Xr/8hHga0olsqbmgYn1OrZ6ijsuJti0TkZOcVMOb7g9Pg4J6If3LXbS2hyryUQidVH8jZIQprpVD549e3rW+HR7Pt7DDSA==',key_name='tempest-keypair-20632901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-8d8965bs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:08:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=03e1e9cb-0954-444f-baf5-cb2e2acd4b3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:84:96,bridge_name='br-int',has_traffic_filtering=True,id=e28ce78b-2583-4ef4-a071-d3b25fc5a3ea,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28ce78b-25') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG os_vif [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:84:96,bridge_name='br-int',has_traffic_filtering=True,id=e28ce78b-2583-4ef4-a071-d3b25fc5a3ea,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28ce78b-25') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6961b569-9afc-597e-9d5b-e8f0fa0bb6b5', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape28ce78b-25, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape28ce78b-25, col_values=(('qos', UUID('a6bd6252-c1a6-4866-95fc-fe108766b323')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape28ce78b-25, col_values=(('external_ids', {'iface-id': 'e28ce78b-2583-4ef4-a071-d3b25fc5a3ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:84:96', 'vm-uuid': '03e1e9cb-0954-444f-baf5-cb2e2acd4b3b'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:03 user nova-compute[74482]: INFO os_vif [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:84:96,bridge_name='br-int',has_traffic_filtering=True,id=e28ce78b-2583-4ef4-a071-d3b25fc5a3ea,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28ce78b-25')
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No VIF found with MAC fa:16:3e:1b:84:96, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.network.neutron [req-01de5469-007e-43ba-a919-7ef00972bb7f req-c61d69d9-3563-42e3-b783-e7ea1f693d0f service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updated VIF entry in instance network info cache for port e28ce78b-2583-4ef4-a071-d3b25fc5a3ea. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG nova.network.neutron [req-01de5469-007e-43ba-a919-7ef00972bb7f req-c61d69d9-3563-42e3-b783-e7ea1f693d0f service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updating instance_info_cache with network_info: [{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:08:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-01de5469-007e-43ba-a919-7ef00972bb7f req-c61d69d9-3563-42e3-b783-e7ea1f693d0f service nova] Releasing lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:08:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-11e8f2e6-60c0-4ed3-b92d-dbbc8d855822 req-290d1e42-3be1-41e8-ae8d-997547ccaa17 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:08:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-11e8f2e6-60c0-4ed3-b92d-dbbc8d855822 req-290d1e42-3be1-41e8-ae8d-997547ccaa17 service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-11e8f2e6-60c0-4ed3-b92d-dbbc8d855822 req-290d1e42-3be1-41e8-ae8d-997547ccaa17 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-11e8f2e6-60c0-4ed3-b92d-dbbc8d855822 req-290d1e42-3be1-41e8-ae8d-997547ccaa17 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-11e8f2e6-60c0-4ed3-b92d-dbbc8d855822 req-290d1e42-3be1-41e8-ae8d-997547ccaa17 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:08:05 user nova-compute[74482]: WARNING nova.compute.manager [req-11e8f2e6-60c0-4ed3-b92d-dbbc8d855822 req-290d1e42-3be1-41e8-ae8d-997547ccaa17 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state building and task_state spawning.
Oct 23 23:08:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:08:07 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Instance spawned successfully.
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-4841d62f-38be-4afa-b431-6e89d5ce1090 req-e217013d-3b1c-4b56-a3c6-39ca3fb4da7d service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4841d62f-38be-4afa-b431-6e89d5ce1090 req-e217013d-3b1c-4b56-a3c6-39ca3fb4da7d service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4841d62f-38be-4afa-b431-6e89d5ce1090 req-e217013d-3b1c-4b56-a3c6-39ca3fb4da7d service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4841d62f-38be-4afa-b431-6e89d5ce1090 req-e217013d-3b1c-4b56-a3c6-39ca3fb4da7d service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-4841d62f-38be-4afa-b431-6e89d5ce1090 req-e217013d-3b1c-4b56-a3c6-39ca3fb4da7d service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:08:07 user nova-compute[74482]: WARNING nova.compute.manager [req-4841d62f-38be-4afa-b431-6e89d5ce1090 req-e217013d-3b1c-4b56-a3c6-39ca3fb4da7d service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state building and task_state spawning.
Oct 23 23:08:07 user nova-compute[74482]: INFO nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Took 6.42 seconds to spawn the instance on the hypervisor.
Oct 23 23:08:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:08:07 user nova-compute[74482]: INFO nova.compute.manager [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Took 7.51 seconds to build instance.
Oct 23 23:08:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d35c9ba9-9607-4159-b319-49ff419d80eb tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.654s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:11 user nova-compute[74482]: INFO nova.compute.manager [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Terminating instance
Oct 23 23:08:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-b53cddec-3f2e-4912-b004-83db036a12f5 req-8a621f10-9ab8-4cc6-b09c-4094aedbffae service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b53cddec-3f2e-4912-b004-83db036a12f5 req-8a621f10-9ab8-4cc6-b09c-4094aedbffae service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b53cddec-3f2e-4912-b004-83db036a12f5 req-8a621f10-9ab8-4cc6-b09c-4094aedbffae service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b53cddec-3f2e-4912-b004-83db036a12f5 req-8a621f10-9ab8-4cc6-b09c-4094aedbffae service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-b53cddec-3f2e-4912-b004-83db036a12f5 req-8a621f10-9ab8-4cc6-b09c-4094aedbffae service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:08:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-b53cddec-3f2e-4912-b004-83db036a12f5 req-8a621f10-9ab8-4cc6-b09c-4094aedbffae service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-unplugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:08:12 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Instance destroyed successfully.
Oct 23 23:08:12 user nova-compute[74482]: DEBUG nova.objects.instance [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lazy-loading 'resources' on Instance uuid aa063829-b117-40f4-93f2-358b33f1d156 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1895303322',display_name='tempest-ServerActionsTestOtherB-server-1895303322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1895303322',id=2,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtTCYnjLWuZ5ND071jtsoNL+jCbUBIt9fx3Xpn4EVHhYK3Fa774GNC5Gw1NBdqzVTnVApUJDfyn5fEVDoKQTbN3TLPt6wiaiOSOkoESIbi/mWxf/f66vq9c/4Twd5CY7Q==',key_name='tempest-keypair-2026660343',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:05:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69039bafbadf4db8862003e2483fc973',ramdisk_id='',reservation_id='r-ejmhk03v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-598393554',owner_user_name='tempest-ServerActionsTestOtherB-598393554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad45a40b18f4217924249b71fd4c93d',uuid=aa063829-b117-40f4-93f2-358b33f1d156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converting VIF {"id": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "address": "fa:16:3e:5f:07:d9", "network": {"id": "f249f914-71c1-4f32-ab77-19ad75279d59", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-98793107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69039bafbadf4db8862003e2483fc973", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dfbe86-37", "ovs_interfaceid": "26dfbe86-3706-4d55-8a27-3e7d97ffbaa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_vif [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26dfbe86-37, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bda8613-46f5-4352-b760-60b6807e8e4b) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:12 user nova-compute[74482]: INFO os_vif [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=26dfbe86-3706-4d55-8a27-3e7d97ffbaa3,network=Network(f249f914-71c1-4f32-ab77-19ad75279d59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dfbe86-37')
Oct 23 23:08:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrQcGyOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:08:12 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96739c5e-45f6-45fa-9f4d-250e2ded3ccd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:08:12 user nova-compute[74482]: No targets found.
Oct 23 23:08:12 user nova-compute[74482]: iSNS:
Oct 23 23:08:12 user nova-compute[74482]: No targets found.
Oct 23 23:08:12 user nova-compute[74482]: STATIC:
Oct 23 23:08:12 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76
Oct 23 23:08:12 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:08:12 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:08:12 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368
Oct 23 23:08:12 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:08:12 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:08:12 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62
Oct 23 23:08:12 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:08:12 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:08:12 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:08:12 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:08:12 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:08:12 user nova-compute[74482]: FIRMWARE:
Oct 23 23:08:12 user nova-compute[74482]: No targets found.
Oct 23 23:08:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:08:12 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:08:12 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cda2a02-94b6-45e2-a108-d35397369fe2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfeec18-7a17-4cdf-a8e5-9c87e42f2cc7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:08:12 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:08:12 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:08:12 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:08:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 (non-flash)
Oct 23 23:08:12 user nova-compute[74482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:08:12 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:08:12 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:08:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c6db6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e304337b-0512-4f67-bf22-a8d57aef0fb0]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[766efc92-5210-4a00-8910-2470a7f8c25d]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7fe89c-a935-42dc-b534-779c7f7b85a7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0148302-ef66-496c-9597-a29656d7ee95]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5184e6-6400-43ba-9235-ba35fe236e19]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccc858a-e5da-4161-a3de-e64274898ed3]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260]
Oct 23 23:08:12 user nova-compute[74482]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368, portal: 172.16.0.220,3260] successful.
Oct 23 23:08:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9f3b0f5-8a19-4913-9e4c-c01c1e2e3368 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc484bfa-e506-4998-a16d-78bf935406ed]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] <== disconnect_volume: return (363ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:08:12 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Deleting instance files /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156_del
Oct 23 23:08:12 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Deletion of /opt/stack/data/nova/instances/aa063829-b117-40f4-93f2-358b33f1d156_del complete
Oct 23 23:08:12 user nova-compute[74482]: INFO nova.compute.manager [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 23 23:08:12 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:08:12 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:08:13 user nova-compute[74482]: INFO nova.compute.claims [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Claim successful on node user
Oct 23 23:08:13 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:08:13 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Took 1.13 seconds to deallocate network for instance.
Oct 23 23:08:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-2fb47b59-ee8d-4c51-afd7-7cb68f6e47ed req-5409aa33-342e-4d3a-b268-6812b402cce3 service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-deleted-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-addac7c6-0b91-4fb7-8a63-d904e8bdcca6 req-f8de1963-71ad-49cb-bd67-e0bbc6e4a4da service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-addac7c6-0b91-4fb7-8a63-d904e8bdcca6 req-f8de1963-71ad-49cb-bd67-e0bbc6e4a4da service nova] Acquiring lock "aa063829-b117-40f4-93f2-358b33f1d156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-addac7c6-0b91-4fb7-8a63-d904e8bdcca6 req-f8de1963-71ad-49cb-bd67-e0bbc6e4a4da service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-addac7c6-0b91-4fb7-8a63-d904e8bdcca6 req-f8de1963-71ad-49cb-bd67-e0bbc6e4a4da service nova] Lock "aa063829-b117-40f4-93f2-358b33f1d156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-addac7c6-0b91-4fb7-8a63-d904e8bdcca6 req-f8de1963-71ad-49cb-bd67-e0bbc6e4a4da service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] No waiting events found dispatching network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:08:13 user nova-compute[74482]: WARNING nova.compute.manager [req-addac7c6-0b91-4fb7-8a63-d904e8bdcca6 req-f8de1963-71ad-49cb-bd67-e0bbc6e4a4da service nova] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Received unexpected event network-vif-plugged-26dfbe86-3706-4d55-8a27-3e7d97ffbaa3 for instance with vm_state active and task_state deleting.
Oct 23 23:08:14 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:08:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:08:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG nova.policy [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f238e70c3ce4b7d9dc694d886fd3613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2e631e89fe4d90a2fceb55819e0c9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:08:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Creating image(s)
Oct 23 23:08:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "/opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "/opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "/opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk 1073741824" returned: 0 in 0.059s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Successfully created port: 1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.213s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Cannot resize image /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Ensure instance console log exists: /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Successfully updated port: 1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "refresh_cache-599b9f36-af3c-405a-ae1d-088325a1fa03" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquired lock "refresh_cache-599b9f36-af3c-405a-ae1d-088325a1fa03" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-bb861df0-4daf-4e48-87fa-4f5f288bf846 req-42ecb04f-9af1-419c-8211-7dfd5dad8d87 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received event network-changed-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-bb861df0-4daf-4e48-87fa-4f5f288bf846 req-42ecb04f-9af1-419c-8211-7dfd5dad8d87 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Refreshing instance network info cache due to event network-changed-1429e61f-b7da-46a7-a714-d6c68b8b8c5f. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bb861df0-4daf-4e48-87fa-4f5f288bf846 req-42ecb04f-9af1-419c-8211-7dfd5dad8d87 service nova] Acquiring lock "refresh_cache-599b9f36-af3c-405a-ae1d-088325a1fa03" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Updating instance_info_cache with network_info: [{"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Releasing lock "refresh_cache-599b9f36-af3c-405a-ae1d-088325a1fa03" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Instance network_info: |[{"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bb861df0-4daf-4e48-87fa-4f5f288bf846 req-42ecb04f-9af1-419c-8211-7dfd5dad8d87 service nova] Acquired lock "refresh_cache-599b9f36-af3c-405a-ae1d-088325a1fa03" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.network.neutron [req-bb861df0-4daf-4e48-87fa-4f5f288bf846 req-42ecb04f-9af1-419c-8211-7dfd5dad8d87 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Refreshing network info cache for port 1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Start _get_guest_xml network_info=[{"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:08:16 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:08:16 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:08:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1089684976',display_name='tempest-TestServerVolumeAttachmentScenario-server-1089684976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1089684976',id=20,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNc3K/1HvzPM/a+VdICuI/wtcveUjdvn81ueHIzr0eCB2BfGHlMKkRQErW/JLJg2TSSbnXjurZd+kyHlaGaoxtbxTrwias2gqdL2O/IEeIRKAhq1upREg4Xn8Un4OSd1Lw==',key_name='tempest-keypair-194814383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc2e631e89fe4d90a2fceb55819e0c9e',ramdisk_id='',reservation_id='r-624v4tvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-379192400',owner_user_name='tempest-TestServerVolumeAttachmentScenario-379192400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f238e70c3ce4b7d9dc694d886fd3613',uuid=599b9f36-af3c-405a-ae1d-088325a1fa03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Converting VIF {"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:fd:fe,bridge_name='br-int',has_traffic_filtering=True,id=1429e61f-b7da-46a7-a714-d6c68b8b8c5f,network=Network(e61d1e0b-5058-4589-8ea1-a8fb1690073d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1429e61f-b7') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lazy-loading 'pci_devices' on Instance uuid 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:08:16 user nova-compute[74482]:   <uuid>599b9f36-af3c-405a-ae1d-088325a1fa03</uuid>
Oct 23 23:08:16 user nova-compute[74482]:   <name>instance-00000014</name>
Oct 23 23:08:16 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:08:16 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:08:16 user nova-compute[74482]:   <metadata>
Oct 23 23:08:16 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:08:16 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:08:16 user nova-compute[74482]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1089684976</nova:name>
Oct 23 23:08:16 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:08:16</nova:creationTime>
Oct 23 23:08:16 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:08:16 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:08:16 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:08:16 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:08:16 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:08:16 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:08:16 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:08:16 user nova-compute[74482]:       <nova:owner>
Oct 23 23:08:16 user nova-compute[74482]:         <nova:user uuid="4f238e70c3ce4b7d9dc694d886fd3613">tempest-TestServerVolumeAttachmentScenario-379192400-project-member</nova:user>
Oct 23 23:08:16 user nova-compute[74482]:         <nova:project uuid="bc2e631e89fe4d90a2fceb55819e0c9e">tempest-TestServerVolumeAttachmentScenario-379192400</nova:project>
Oct 23 23:08:16 user nova-compute[74482]:       </nova:owner>
Oct 23 23:08:16 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:08:16 user nova-compute[74482]:       <nova:ports>
Oct 23 23:08:16 user nova-compute[74482]:         <nova:port uuid="1429e61f-b7da-46a7-a714-d6c68b8b8c5f">
Oct 23 23:08:16 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 23:08:16 user nova-compute[74482]:         </nova:port>
Oct 23 23:08:16 user nova-compute[74482]:       </nova:ports>
Oct 23 23:08:16 user nova-compute[74482]:     </nova:instance>
Oct 23 23:08:16 user nova-compute[74482]:   </metadata>
Oct 23 23:08:16 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:08:16 user nova-compute[74482]:     <system>
Oct 23 23:08:16 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:08:16 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:08:16 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:08:16 user nova-compute[74482]:       <entry name="serial">599b9f36-af3c-405a-ae1d-088325a1fa03</entry>
Oct 23 23:08:16 user nova-compute[74482]:       <entry name="uuid">599b9f36-af3c-405a-ae1d-088325a1fa03</entry>
Oct 23 23:08:16 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:08:16 user nova-compute[74482]:     </system>
Oct 23 23:08:16 user nova-compute[74482]:   </sysinfo>
Oct 23 23:08:16 user nova-compute[74482]:   <os>
Oct 23 23:08:16 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:08:16 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:08:16 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:08:16 user nova-compute[74482]:   </os>
Oct 23 23:08:16 user nova-compute[74482]:   <features>
Oct 23 23:08:16 user nova-compute[74482]:     <acpi/>
Oct 23 23:08:16 user nova-compute[74482]:     <apic/>
Oct 23 23:08:16 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:08:16 user nova-compute[74482]:   </features>
Oct 23 23:08:16 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:08:16 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:08:16 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:08:16 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:08:16 user nova-compute[74482]:   </clock>
Oct 23 23:08:16 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:08:16 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:08:16 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:08:16 user nova-compute[74482]:   </cpu>
Oct 23 23:08:16 user nova-compute[74482]:   <devices>
Oct 23 23:08:16 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:08:16 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:08:16 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk"/>
Oct 23 23:08:16 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:08:16 user nova-compute[74482]:     </disk>
Oct 23 23:08:16 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:08:16 user nova-compute[74482]:       <mac address="fa:16:3e:99:fd:fe"/>
Oct 23 23:08:16 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:08:16 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:08:16 user nova-compute[74482]:       <target dev="tap1429e61f-b7"/>
Oct 23 23:08:16 user nova-compute[74482]:     </interface>
Oct 23 23:08:16 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:08:16 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/console.log" append="off"/>
Oct 23 23:08:16 user nova-compute[74482]:     </serial>
Oct 23 23:08:16 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:08:16 user nova-compute[74482]:     <video>
Oct 23 23:08:16 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:08:16 user nova-compute[74482]:     </video>
Oct 23 23:08:16 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:08:16 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:08:16 user nova-compute[74482]:     </rng>
Oct 23 23:08:16 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:08:16 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:08:16 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:08:16 user nova-compute[74482]:     </memballoon>
Oct 23 23:08:16 user nova-compute[74482]:   </devices>
Oct 23 23:08:16 user nova-compute[74482]: </domain>
Oct 23 23:08:16 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:08:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1089684976',display_name='tempest-TestServerVolumeAttachmentScenario-server-1089684976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1089684976',id=20,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNc3K/1HvzPM/a+VdICuI/wtcveUjdvn81ueHIzr0eCB2BfGHlMKkRQErW/JLJg2TSSbnXjurZd+kyHlaGaoxtbxTrwias2gqdL2O/IEeIRKAhq1upREg4Xn8Un4OSd1Lw==',key_name='tempest-keypair-194814383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc2e631e89fe4d90a2fceb55819e0c9e',ramdisk_id='',reservation_id='r-624v4tvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-379192400',owner_user_name='tempest-TestServerVolumeAttachmentScenario-379192400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f238e70c3ce4b7d9dc694d886fd3613',uuid=599b9f36-af3c-405a-ae1d-088325a1fa03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Converting VIF {"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:fd:fe,bridge_name='br-int',has_traffic_filtering=True,id=1429e61f-b7da-46a7-a714-d6c68b8b8c5f,network=Network(e61d1e0b-5058-4589-8ea1-a8fb1690073d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1429e61f-b7') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG os_vif [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:fd:fe,bridge_name='br-int',has_traffic_filtering=True,id=1429e61f-b7da-46a7-a714-d6c68b8b8c5f,network=Network(e61d1e0b-5058-4589-8ea1-a8fb1690073d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1429e61f-b7') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ceb75e0-3911-5cc9-8e0b-a9651092e3d2', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1429e61f-b7, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1429e61f-b7, col_values=(('qos', UUID('651e5aea-245b-4f2f-bcee-66425443445b')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1429e61f-b7, col_values=(('external_ids', {'iface-id': '1429e61f-b7da-46a7-a714-d6c68b8b8c5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:fd:fe', 'vm-uuid': '599b9f36-af3c-405a-ae1d-088325a1fa03'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:16 user nova-compute[74482]: INFO os_vif [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:fd:fe,bridge_name='br-int',has_traffic_filtering=True,id=1429e61f-b7da-46a7-a714-d6c68b8b8c5f,network=Network(e61d1e0b-5058-4589-8ea1-a8fb1690073d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1429e61f-b7')
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:08:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] No VIF found with MAC fa:16:3e:99:fd:fe, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:08:17 user nova-compute[74482]: DEBUG nova.network.neutron [req-bb861df0-4daf-4e48-87fa-4f5f288bf846 req-42ecb04f-9af1-419c-8211-7dfd5dad8d87 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Updated VIF entry in instance network info cache for port 1429e61f-b7da-46a7-a714-d6c68b8b8c5f. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:08:17 user nova-compute[74482]: DEBUG nova.network.neutron [req-bb861df0-4daf-4e48-87fa-4f5f288bf846 req-42ecb04f-9af1-419c-8211-7dfd5dad8d87 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Updating instance_info_cache with network_info: [{"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:08:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bb861df0-4daf-4e48-87fa-4f5f288bf846 req-42ecb04f-9af1-419c-8211-7dfd5dad8d87 service nova] Releasing lock "refresh_cache-599b9f36-af3c-405a-ae1d-088325a1fa03" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:08:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-b5bec506-a287-4c91-8007-56060b49ed6f req-41754044-4503-4e9f-bc12-ccaed5e3c70d service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received event network-vif-plugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:08:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b5bec506-a287-4c91-8007-56060b49ed6f req-41754044-4503-4e9f-bc12-ccaed5e3c70d service nova] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b5bec506-a287-4c91-8007-56060b49ed6f req-41754044-4503-4e9f-bc12-ccaed5e3c70d service nova] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b5bec506-a287-4c91-8007-56060b49ed6f req-41754044-4503-4e9f-bc12-ccaed5e3c70d service nova] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-b5bec506-a287-4c91-8007-56060b49ed6f req-41754044-4503-4e9f-bc12-ccaed5e3c70d service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] No waiting events found dispatching network-vif-plugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:08:18 user nova-compute[74482]: WARNING nova.compute.manager [req-b5bec506-a287-4c91-8007-56060b49ed6f req-41754044-4503-4e9f-bc12-ccaed5e3c70d service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received unexpected event network-vif-plugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f for instance with vm_state building and task_state spawning.
Oct 23 23:08:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:19 user nova-compute[74482]: INFO nova.compute.manager [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] [instance: aa063829-b117-40f4-93f2-358b33f1d156] Took 5.20 seconds to detach 1 volumes for instance.
Oct 23 23:08:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:19 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:08:19 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:08:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:19 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Deleted allocations for instance aa063829-b117-40f4-93f2-358b33f1d156
Oct 23 23:08:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-513d222b-2104-4b9d-8541-101b482903de tempest-ServerActionsTestOtherB-598393554 tempest-ServerActionsTestOtherB-598393554-project-member] Lock "aa063829-b117-40f4-93f2-358b33f1d156" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.477s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-556cd6b3-036c-470d-abd1-f19eb590b240 req-bdcb25b7-f5dc-47f8-8925-61964064f12c service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received event network-vif-plugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-556cd6b3-036c-470d-abd1-f19eb590b240 req-bdcb25b7-f5dc-47f8-8925-61964064f12c service nova] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-556cd6b3-036c-470d-abd1-f19eb590b240 req-bdcb25b7-f5dc-47f8-8925-61964064f12c service nova] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-556cd6b3-036c-470d-abd1-f19eb590b240 req-bdcb25b7-f5dc-47f8-8925-61964064f12c service nova] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-556cd6b3-036c-470d-abd1-f19eb590b240 req-bdcb25b7-f5dc-47f8-8925-61964064f12c service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] No waiting events found dispatching network-vif-plugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:08:20 user nova-compute[74482]: WARNING nova.compute.manager [req-556cd6b3-036c-470d-abd1-f19eb590b240 req-bdcb25b7-f5dc-47f8-8925-61964064f12c service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received unexpected event network-vif-plugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f for instance with vm_state building and task_state spawning.
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:08:20 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Instance spawned successfully.
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:08:20 user nova-compute[74482]: INFO nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Took 6.21 seconds to spawn the instance on the hypervisor.
Oct 23 23:08:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:08:20 user nova-compute[74482]: INFO nova.compute.manager [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Took 7.43 seconds to build instance.
Oct 23 23:08:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad1c204a-8eea-4a4b-bbf2-cc9c5471a177 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.603s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOuFxatB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:08:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:08:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:08:22 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4466df-68d4-4844-be55-bdaf816ff378]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:08:22 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d2675-25af-43b7-bc42-c3d0f172786a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916] added
Oct 23 23:08:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8695a5-3f99-4ee6-9d6e-f9b9ed5ee869]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[503596e0-c58b-4d78-a982-7f37b7e890ce]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOuFxatB {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOuFxatB" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38f53ec-ae0e-4234-a26f-0a7ef01d2741]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOuFxatB'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90ea7f5-8bda-4636-a210-e0a7700a97aa]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff56785b-f20e-4b4a-a6b3-f86859b30186]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37daf27b-298b-42a0-bd49-3ccc051e56b1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37daf27b-298b-42a0-bd49-3ccc051e56b1 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37daf27b-298b-42a0-bd49-3ccc051e56b1 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac35207-9c58-4f2d-87aa-f387de51bda8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916, portal: 172.16.0.220,3260]
Oct 23 23:08:23 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916, portal: 172.16.0.220,3260] successful.
Oct 23 23:08:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f1ea28-d18b-4376-a685-75a0ca8f5bc8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e005c41-da68-4860-8768-de3f26f1c191]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37daf27b-298b-42a0-bd49-3ccc051e56b1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37daf27b-298b-42a0-bd49-3ccc051e56b1 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37daf27b-298b-42a0-bd49-3ccc051e56b1 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:08:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecd02b0-055a-4171-9844-04b60ff26f95]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:08:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOuFxatB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26564363761626437', 'path': '/dev/sdf'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564363761626437', 'path': '/dev/sdf'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG nova.objects.instance [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lazy-loading 'flavor' on Instance uuid 1718ea62-105b-44ac-80f6-587224314449 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:08:24 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:08:24 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:08:24 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:08:24 user nova-compute[74482]:   <serial>204c3abb-1574-44f9-912f-69a44333b916</serial>
Oct 23 23:08:24 user nova-compute[74482]: </disk>
Oct 23 23:08:24 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:08:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] No VIF found with MAC fa:16:3e:37:12:4f, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-35ae5f4c-4856-401c-8224-1a05d1a9bfb4 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.440s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updating instance_info_cache with network_info: [{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:08:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:26 user nova-compute[74482]: INFO nova.compute.manager [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Detaching volume 204c3abb-1574-44f9-912f-69a44333b916
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:26 user nova-compute[74482]: INFO nova.virt.block_device [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Attempting to driver detach volume 204c3abb-1574-44f9-912f-69a44333b916 from mountpoint /dev/vdb
Oct 23 23:08:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Attempting to detach device vdb from instance 1718ea62-105b-44ac-80f6-587224314449 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:08:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:08:26 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:08:26 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:08:26 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:08:26 user nova-compute[74482]:   <serial>204c3abb-1574-44f9-912f-69a44333b916</serial>
Oct 23 23:08:26 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:08:26 user nova-compute[74482]: </disk>
Oct 23 23:08:26 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:08:26 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Successfully detached device vdb from instance 1718ea62-105b-44ac-80f6-587224314449 from the persistent domain config.
Oct 23 23:08:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1718ea62-105b-44ac-80f6-587224314449 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:08:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:08:27 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:08:27 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:08:27 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:08:27 user nova-compute[74482]:   <serial>204c3abb-1574-44f9-912f-69a44333b916</serial>
Oct 23 23:08:27 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:08:27 user nova-compute[74482]: </disk>
Oct 23 23:08:27 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:08:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.267s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.279s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1718ea62-105b-44ac-80f6-587224314449 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:08:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:31 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:08:31 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7508MB free_disk=25.04328155517578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 1718ea62-105b-44ac-80f6-587224314449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance a18c958b-f7d9-47ba-ad98-332e12838d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 599b9f36-af3c-405a-ae1d-088325a1fa03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:08:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:32 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:08:32 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:08:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:08:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.198s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:47 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1718ea62-105b-44ac-80f6-587224314449 is timed out.
Oct 23 23:08:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Successfully detached device vdb from instance 1718ea62-105b-44ac-80f6-587224314449 from the live domain config.
Oct 23 23:08:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOuFxatB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:08:47 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3878292a-6a5e-4b61-aa03-00d20b8b5fee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:08:47 user nova-compute[74482]: No targets found.
Oct 23 23:08:47 user nova-compute[74482]: iSNS:
Oct 23 23:08:47 user nova-compute[74482]: No targets found.
Oct 23 23:08:47 user nova-compute[74482]: STATIC:
Oct 23 23:08:47 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76
Oct 23 23:08:47 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:08:47 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:08:47 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62
Oct 23 23:08:47 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:08:47 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:08:47 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:08:47 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:08:47 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:08:47 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916
Oct 23 23:08:47 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:08:47 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:08:47 user nova-compute[74482]: FIRMWARE:
Oct 23 23:08:47 user nova-compute[74482]: No targets found.
Oct 23 23:08:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:08:47 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:08:47 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fa3374-10e9-44c4-b929-24b160305429]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0771d9bd-ea60-4474-960f-8b5bbfaa3c37]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:08:47 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:08:47 user nova-compute[74482]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 (non-flash)
Oct 23 23:08:47 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:08:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:08:47 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:08:47 user nova-compute[74482]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 (non-flash)
Oct 23 23:08:47 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:08:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c6d8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916'): ({'sdf'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Removing single pathed devices sdf {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab9e048-8b0b-42fb-a084-15f2ce2764e2]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7159d6ed-df4e-4914-8e0e-5952c8a8953e]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Flushing IO for device /dev/sdf {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e29de7-dfc0-40b9-8ea4-260cf78488ca]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc19b0ef-aeef-469d-9451-bcffa40a2c79]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[654778ef-95eb-488f-b6be-95a794070854]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bca2369-9dab-464a-b691-1cff5405a59c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916, portal: 172.16.0.220,3260]
Oct 23 23:08:47 user nova-compute[74482]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916, portal: 172.16.0.220,3260] successful.
Oct 23 23:08:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204c3abb-1574-44f9-912f-69a44333b916 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10edb2a-bff6-47f2-92ee-e88072132654]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] <== disconnect_volume: return (338ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:08:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:08:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:48 user nova-compute[74482]: DEBUG nova.objects.instance [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lazy-loading 'flavor' on Instance uuid 1718ea62-105b-44ac-80f6-587224314449 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:08:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-499837e7-3f22-48c9-83e8-8f825cdbbbcf tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.977s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:08:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:58 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:08:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:08:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquired lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:08:58 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:08:58 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'info_cache' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:08:58 user nova-compute[74482]: DEBUG nova.objects.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:08:59 user nova-compute[74482]: INFO nova.compute.manager [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Detaching volume 926911cd-cb13-410d-80a2-b33f3d262b62
Oct 23 23:08:59 user nova-compute[74482]: INFO nova.virt.block_device [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Attempting to driver detach volume 926911cd-cb13-410d-80a2-b33f3d262b62 from mountpoint /dev/vdb
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Attempting to detach device vdb from instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:08:59 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:08:59 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:08:59 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:08:59 user nova-compute[74482]:   <serial>926911cd-cb13-410d-80a2-b33f3d262b62</serial>
Oct 23 23:08:59 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 23:08:59 user nova-compute[74482]: </disk>
Oct 23 23:08:59 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:08:59 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully detached device vdb from instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 from the persistent domain config.
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:08:59 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:08:59 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:08:59 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:08:59 user nova-compute[74482]:   <serial>926911cd-cb13-410d-80a2-b33f3d262b62</serial>
Oct 23 23:08:59 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 23:08:59 user nova-compute[74482]: </disk>
Oct 23 23:08:59 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updating instance_info_cache with network_info: [{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Releasing lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:08:59 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance destroyed successfully.
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'resources' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.objects.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-439136322',display_name='tempest-AttachVolumeTestJSON-server-439136322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-439136322',id=15,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2iGfEXaPgxPn5izpripEi2/XY/bHunM2ZOKB1jTII0azdkSPatKwlT3TbO7EwNnoRFvRzERTAu0AuwvB5cbX4ENLG57+jsj++oymIjEa63YTDE00owdCA8Ukeap2uu+A==',key_name='tempest-keypair-837672835',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-la2mgmq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=bbedc3ec-0f54-4977-8546-41ce4f488641,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG os_vif [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b2e69e1-e9, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4b1a2c8-60ac-448f-a45b-a9e1b937e72b) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:08:59 user nova-compute[74482]: INFO os_vif [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9')
Oct 23 23:08:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVskdhMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:08:59 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:08:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:08:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40832f8-8238-43e6-8bde-49443d2485f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:09:00 user nova-compute[74482]: No targets found.
Oct 23 23:09:00 user nova-compute[74482]: iSNS:
Oct 23 23:09:00 user nova-compute[74482]: No targets found.
Oct 23 23:09:00 user nova-compute[74482]: STATIC:
Oct 23 23:09:00 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76
Oct 23 23:09:00 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:09:00 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:09:00 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62
Oct 23 23:09:00 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:09:00 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:09:00 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:09:00 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:09:00 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:09:00 user nova-compute[74482]: FIRMWARE:
Oct 23 23:09:00 user nova-compute[74482]: No targets found.
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:09:00 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:09:00 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e2b543-aae3-486f-bcc7-42f975a249bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccf4465-fed1-46d5-a79a-1b0424612e64]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c727490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76'): ({'sdd'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Removing single pathed devices sdd {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[609961fb-2ff9-4e05-9eff-e9dcc88b393c]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d7c002-e0b0-4325-81eb-1e6fbd3a6eef]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flushing IO for device /dev/sdd {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a6780e-bdd1-4572-96ab-89feb469cee0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[df07174c-409a-4626-a0be-99719d973c46]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[da340453-d16d-4b35-83ac-dc6a1a7a0f72]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.128s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a1a684-be88-4548-80a8-c0dca061c0ca]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260]
Oct 23 23:09:00 user nova-compute[74482]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260] successful.
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff05076-2c88-4ff5-99a7-b1e9a9941553]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== disconnect_volume: return (426ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Start _get_guest_xml network_info=[{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVskdhMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'bbedc3ec-0f54-4977-8546-41ce4f488641', 'attached_at': '', 'detached_at': '', 'volume_id': '9a907fac-6bfc-418a-9a11-c56983d1ae76', 'serial': '9a907fac-6bfc-418a-9a11-c56983d1ae76'}, 'disk_bus': 'virtio', 'attachment_id': 'f571ef38-a7de-4657-894f-5f2e7702754d', 'boot_index': None, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'numa_topology' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.objects.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:09:00 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:09:00 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'vcpu_model' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.objects.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVskdhMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:09:00 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:09:00 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:09:00 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e0d56-5e28-4fc1-8dbb-99c5c4928b55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:09:00 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c855a13-b0da-403d-822d-bc76c7a24de3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76] added
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[356e6643-7bdd-4229-9006-8a4352e056ca]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1023c009-e6f8-4cdb-a3ed-b29a76ba4048]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVskdhMI {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVskdhMI" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca775181-bf80-46e5-845c-e237002a8075]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVskdhMI'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b934a03-7c22-4753-84c1-199c9b48272c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e2816b-1103-4168-af10-d7345102d85d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c19bda6-4c5f-44e9-b3db-a329cf717c60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260]
Oct 23 23:09:00 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260] successful.
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[166b055b-8af4-434d-9bcf-cb5b8b815227]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1309725-2774-4f46-89f4-9870f921f30f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:09:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5a6fd3-d532-4c0f-9dfc-465ef15efcd1]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVskdhMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26561353664393136', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561353664393136', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-439136322',display_name='tempest-AttachVolumeTestJSON-server-439136322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-439136322',id=15,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2iGfEXaPgxPn5izpripEi2/XY/bHunM2ZOKB1jTII0azdkSPatKwlT3TbO7EwNnoRFvRzERTAu0AuwvB5cbX4ENLG57+jsj++oymIjEa63YTDE00owdCA8Ukeap2uu+A==',key_name='tempest-keypair-837672835',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-la2mgmq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=bbedc3ec-0f54-4977-8546-41ce4f488641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'pci_devices' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG nova.objects.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:09:01 user nova-compute[74482]:   <uuid>bbedc3ec-0f54-4977-8546-41ce4f488641</uuid>
Oct 23 23:09:01 user nova-compute[74482]:   <name>instance-0000000f</name>
Oct 23 23:09:01 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:09:01 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:09:01 user nova-compute[74482]:   <metadata>
Oct 23 23:09:01 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:09:01 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:09:01 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeTestJSON-server-439136322</nova:name>
Oct 23 23:09:01 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:09:00</nova:creationTime>
Oct 23 23:09:01 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:09:01 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:09:01 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:09:01 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:09:01 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:09:01 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:09:01 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:09:01 user nova-compute[74482]:       <nova:owner>
Oct 23 23:09:01 user nova-compute[74482]:         <nova:user uuid="ba4aeef9339f48d6929e4cfa97af0860">tempest-AttachVolumeTestJSON-1506893999-project-member</nova:user>
Oct 23 23:09:01 user nova-compute[74482]:         <nova:project uuid="5bef228274d9477091fcd021ca8271e3">tempest-AttachVolumeTestJSON-1506893999</nova:project>
Oct 23 23:09:01 user nova-compute[74482]:       </nova:owner>
Oct 23 23:09:01 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:09:01 user nova-compute[74482]:       <nova:ports>
Oct 23 23:09:01 user nova-compute[74482]:         <nova:port uuid="9b2e69e1-e9e5-47ee-a252-cc7e568d4523">
Oct 23 23:09:01 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 23:09:01 user nova-compute[74482]:         </nova:port>
Oct 23 23:09:01 user nova-compute[74482]:       </nova:ports>
Oct 23 23:09:01 user nova-compute[74482]:     </nova:instance>
Oct 23 23:09:01 user nova-compute[74482]:   </metadata>
Oct 23 23:09:01 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:09:01 user nova-compute[74482]:     <system>
Oct 23 23:09:01 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:09:01 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:09:01 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:09:01 user nova-compute[74482]:       <entry name="serial">bbedc3ec-0f54-4977-8546-41ce4f488641</entry>
Oct 23 23:09:01 user nova-compute[74482]:       <entry name="uuid">bbedc3ec-0f54-4977-8546-41ce4f488641</entry>
Oct 23 23:09:01 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:09:01 user nova-compute[74482]:     </system>
Oct 23 23:09:01 user nova-compute[74482]:   </sysinfo>
Oct 23 23:09:01 user nova-compute[74482]:   <os>
Oct 23 23:09:01 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:09:01 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:09:01 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:09:01 user nova-compute[74482]:   </os>
Oct 23 23:09:01 user nova-compute[74482]:   <features>
Oct 23 23:09:01 user nova-compute[74482]:     <acpi/>
Oct 23 23:09:01 user nova-compute[74482]:     <apic/>
Oct 23 23:09:01 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:09:01 user nova-compute[74482]:   </features>
Oct 23 23:09:01 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:09:01 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:09:01 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:09:01 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:09:01 user nova-compute[74482]:   </clock>
Oct 23 23:09:01 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:09:01 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:09:01 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:09:01 user nova-compute[74482]:   </cpu>
Oct 23 23:09:01 user nova-compute[74482]:   <devices>
Oct 23 23:09:01 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:09:01 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:09:01 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk"/>
Oct 23 23:09:01 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:09:01 user nova-compute[74482]:     </disk>
Oct 23 23:09:01 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:09:01 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:09:01 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:09:01 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:09:01 user nova-compute[74482]:       <serial>9a907fac-6bfc-418a-9a11-c56983d1ae76</serial>
Oct 23 23:09:01 user nova-compute[74482]:     </disk>
Oct 23 23:09:01 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:09:01 user nova-compute[74482]:       <mac address="fa:16:3e:f4:77:36"/>
Oct 23 23:09:01 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:09:01 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:09:01 user nova-compute[74482]:       <target dev="tap9b2e69e1-e9"/>
Oct 23 23:09:01 user nova-compute[74482]:     </interface>
Oct 23 23:09:01 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:09:01 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/console.log" append="off"/>
Oct 23 23:09:01 user nova-compute[74482]:     </serial>
Oct 23 23:09:01 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:09:01 user nova-compute[74482]:     <video>
Oct 23 23:09:01 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:09:01 user nova-compute[74482]:     </video>
Oct 23 23:09:01 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:09:01 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:09:01 user nova-compute[74482]:     </rng>
Oct 23 23:09:01 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:09:01 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:09:01 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:09:01 user nova-compute[74482]:     </memballoon>
Oct 23 23:09:01 user nova-compute[74482]:   </devices>
Oct 23 23:09:01 user nova-compute[74482]: </domain>
Oct 23 23:09:01 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:09:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'trusted_certs' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.objects.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Cannot resize image /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'migration_context' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.objects.base [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-439136322',display_name='tempest-AttachVolumeTestJSON-server-439136322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-439136322',id=15,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2iGfEXaPgxPn5izpripEi2/XY/bHunM2ZOKB1jTII0azdkSPatKwlT3TbO7EwNnoRFvRzERTAu0AuwvB5cbX4ENLG57+jsj++oymIjEa63YTDE00owdCA8Ukeap2uu+A==',key_name='tempest-keypair-837672835',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-la2mgmq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=bbedc3ec-0f54-4977-8546-41ce4f488641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG os_vif [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd01e535d-6286-5015-ae64-9329ce9105df', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b2e69e1-e9, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b2e69e1-e9, col_values=(('qos', UUID('af64cbb5-dd8f-446a-ac09-b9894f9d350b')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b2e69e1-e9, col_values=(('external_ids', {'iface-id': '9b2e69e1-e9e5-47ee-a252-cc7e568d4523', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:77:36', 'vm-uuid': 'bbedc3ec-0f54-4977-8546-41ce4f488641'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:09:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:02 user nova-compute[74482]: INFO os_vif [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9')
Oct 23 23:09:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-403ba388-f03c-4b9e-a263-711a59f98a57 req-d94b3b41-9754-43d5-90f3-4dc6f73d308b service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-403ba388-f03c-4b9e-a263-711a59f98a57 req-d94b3b41-9754-43d5-90f3-4dc6f73d308b service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-403ba388-f03c-4b9e-a263-711a59f98a57 req-d94b3b41-9754-43d5-90f3-4dc6f73d308b service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-403ba388-f03c-4b9e-a263-711a59f98a57 req-d94b3b41-9754-43d5-90f3-4dc6f73d308b service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-403ba388-f03c-4b9e-a263-711a59f98a57 req-d94b3b41-9754-43d5-90f3-4dc6f73d308b service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:09:04 user nova-compute[74482]: WARNING nova.compute.manager [req-403ba388-f03c-4b9e-a263-711a59f98a57 req-d94b3b41-9754-43d5-90f3-4dc6f73d308b service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state stopped and task_state powering-on.
Oct 23 23:09:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-2012b844-516d-4d17-9bef-fa99391316da req-4f4d0a2f-d02e-4bec-8793-92d4ea5aa8c1 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2012b844-516d-4d17-9bef-fa99391316da req-4f4d0a2f-d02e-4bec-8793-92d4ea5aa8c1 service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2012b844-516d-4d17-9bef-fa99391316da req-4f4d0a2f-d02e-4bec-8793-92d4ea5aa8c1 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2012b844-516d-4d17-9bef-fa99391316da req-4f4d0a2f-d02e-4bec-8793-92d4ea5aa8c1 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-2012b844-516d-4d17-9bef-fa99391316da req-4f4d0a2f-d02e-4bec-8793-92d4ea5aa8c1 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:09:06 user nova-compute[74482]: WARNING nova.compute.manager [req-2012b844-516d-4d17-9bef-fa99391316da req-4f4d0a2f-d02e-4bec-8793-92d4ea5aa8c1 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state stopped and task_state powering-on.
Oct 23 23:09:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:09:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance rebooted successfully.
Oct 23 23:09:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ef4bbe75-f0ec-44f6-bd0d-f0c0ceaba018 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:09:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "100db750-f1d1-4823-89e3-0e1089266725" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "100db750-f1d1-4823-89e3-0e1089266725" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:18 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:09:18 user nova-compute[74482]: INFO nova.compute.claims [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Claim successful on node user
Oct 23 23:09:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.589s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:09:19 user nova-compute[74482]: INFO nova.compute.claims [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Claim successful on node user
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:09:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:09:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Creating image(s)
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "/opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "/opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "/opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG nova.policy [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f2f6cc277224a04a377fc0bfc3b5021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b95877b43e4d458fd124f0ae506aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.220s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.204s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.790s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk 1073741824" returned: 0 in 0.058s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 is timed out.
Oct 23 23:09:20 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully detached device vdb from instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 from the live domain config.
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:09:20 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThXYdgFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:09:20 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a7e7b5-dd3a-40ee-b91b-f7f1d24324c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:09:20 user nova-compute[74482]: No targets found.
Oct 23 23:09:20 user nova-compute[74482]: iSNS:
Oct 23 23:09:20 user nova-compute[74482]: No targets found.
Oct 23 23:09:20 user nova-compute[74482]: STATIC:
Oct 23 23:09:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76
Oct 23 23:09:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:09:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:09:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62
Oct 23 23:09:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:09:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:09:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:09:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:09:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:09:20 user nova-compute[74482]: FIRMWARE:
Oct 23 23:09:20 user nova-compute[74482]: No targets found.
Oct 23 23:09:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:09:20 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:09:20 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[483a54eb-8a5b-41ec-8f06-82f1efc063fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50b4168-6d06-44af-82d0-177637e40e44]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:09:20 user nova-compute[74482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:09:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:09:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 (non-flash)
Oct 23 23:09:20 user nova-compute[74482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:09:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:09:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c441bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62'): ({'sde'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Removing single pathed devices sde {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.policy [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58e1ae75bd484d3ea749e10346671167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf59ee373fd04ceda1c9212af985f052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4529c17c-8d5b-4215-bad0-c920fc0fb9e8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[869f8d62-f334-43af-b255-e8562e392bfe]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flushing IO for device /dev/sde {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.267s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[de20dff1-b9b7-453b-8653-9fe7787de37a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:09:20 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Creating image(s)
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "/opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "/opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "/opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "7f07d43b3936431260ee5bc51347aa653a1bbf06" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "7f07d43b3936431260ee5bc51347aa653a1bbf06" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Successfully created port: 14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e652b89-8394-41bd-98da-e7b1baad86f6]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b5ad26-fc92-4453-8e57-f0821bffc3bb]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d065e3-dc47-4584-aead-e42420c1e171]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260]
Oct 23 23:09:21 user nova-compute[74482]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62, portal: 172.16.0.220,3260] successful.
Oct 23 23:09:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json" returned: 0 in 0.552s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Cannot resize image /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Ensure instance console log exists: /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:926911cd-cb13-410d-80a2-b33f3d262b62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8092bdb9-48dd-473a-8267-945d3da879cb]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.749s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== disconnect_volume: return (751ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06.part --force-share --output=json" returned: 0 in 0.254s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.virt.images [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] 5487da70-f1de-4665-a9d6-6b9ab731970f was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06.part /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Successfully created port: fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06.part /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06.converted" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Successfully updated port: 14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-fe88ad22-369b-4978-82c0-8f42fba23327 req-3041fa29-8d50-42bc-884a-bc8524b5772c service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received event network-changed-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-fe88ad22-369b-4978-82c0-8f42fba23327 req-3041fa29-8d50-42bc-884a-bc8524b5772c service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Refreshing instance network info cache due to event network-changed-14caf373-8f4a-4b82-80a1-3d55c61cdb6d. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fe88ad22-369b-4978-82c0-8f42fba23327 req-3041fa29-8d50-42bc-884a-bc8524b5772c service nova] Acquiring lock "refresh_cache-100db750-f1d1-4823-89e3-0e1089266725" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fe88ad22-369b-4978-82c0-8f42fba23327 req-3041fa29-8d50-42bc-884a-bc8524b5772c service nova] Acquired lock "refresh_cache-100db750-f1d1-4823-89e3-0e1089266725" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.network.neutron [req-fe88ad22-369b-4978-82c0-8f42fba23327 req-3041fa29-8d50-42bc-884a-bc8524b5772c service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Refreshing network info cache for port 14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "refresh_cache-100db750-f1d1-4823-89e3-0e1089266725" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06.converted --force-share --output=json" returned: 0 in 0.248s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "7f07d43b3936431260ee5bc51347aa653a1bbf06" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.133s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG nova.network.neutron [req-fe88ad22-369b-4978-82c0-8f42fba23327 req-3041fa29-8d50-42bc-884a-bc8524b5772c service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 --force-share --output=json" returned: 0 in 0.236s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "7f07d43b3936431260ee5bc51347aa653a1bbf06" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "7f07d43b3936431260ee5bc51347aa653a1bbf06" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-fe88ad22-369b-4978-82c0-8f42fba23327 req-3041fa29-8d50-42bc-884a-bc8524b5772c service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fe88ad22-369b-4978-82c0-8f42fba23327 req-3041fa29-8d50-42bc-884a-bc8524b5772c service nova] Releasing lock "refresh_cache-100db750-f1d1-4823-89e3-0e1089266725" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquired lock "refresh_cache-100db750-f1d1-4823-89e3-0e1089266725" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.objects.instance [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'flavor' on Instance uuid 2a91897d-e83c-4396-8584-c8ff4fcfc553 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Successfully updated port: fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquired lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-904d1753-7f52-4ca2-967d-187ee626dceb tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.676s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 --force-share --output=json" returned: 0 in 0.249s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06,backing_fmt=raw /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-9b26eca7-4a84-4850-ab95-b077ff726f8a req-d9e6eca4-fdae-4778-b9da-ae5a8e7281fd service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-9b26eca7-4a84-4850-ab95-b077ff726f8a req-d9e6eca4-fdae-4778-b9da-ae5a8e7281fd service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing instance network info cache due to event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9b26eca7-4a84-4850-ab95-b077ff726f8a req-d9e6eca4-fdae-4778-b9da-ae5a8e7281fd service nova] Acquiring lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06,backing_fmt=raw /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk 1073741824" returned: 0 in 0.071s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "7f07d43b3936431260ee5bc51347aa653a1bbf06" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 --force-share --output=json" returned: 0 in 0.210s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Cannot resize image /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Ensure instance console log exists: /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Updating instance_info_cache with network_info: [{"id": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "address": "fa:16:3e:07:f7:09", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14caf373-8f", "ovs_interfaceid": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Releasing lock "refresh_cache-100db750-f1d1-4823-89e3-0e1089266725" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Instance network_info: |[{"id": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "address": "fa:16:3e:07:f7:09", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14caf373-8f", "ovs_interfaceid": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Start _get_guest_xml network_info=[{"id": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "address": "fa:16:3e:07:f7:09", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14caf373-8f", "ovs_interfaceid": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:09:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:09:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1137023492',display_name='tempest-VolumesAdminNegativeTest-server-1137023492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1137023492',id=21,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98b95877b43e4d458fd124f0ae506aaf',ramdisk_id='',reservation_id='r-mz62ec6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1781155714',owner_user_name='tempest-VolumesAdminNegativeTest-1781155714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:09:20Z,user_data=None,user_id='4f2f6cc277224a04a377fc0bfc3b5021',uuid=100db750-f1d1-4823-89e3-0e1089266725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "address": "fa:16:3e:07:f7:09", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14caf373-8f", "ovs_interfaceid": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converting VIF {"id": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "address": "fa:16:3e:07:f7:09", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14caf373-8f", "ovs_interfaceid": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f7:09,bridge_name='br-int',has_traffic_filtering=True,id=14caf373-8f4a-4b82-80a1-3d55c61cdb6d,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14caf373-8f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.objects.instance [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lazy-loading 'pci_devices' on Instance uuid 100db750-f1d1-4823-89e3-0e1089266725 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:09:22 user nova-compute[74482]:   <uuid>100db750-f1d1-4823-89e3-0e1089266725</uuid>
Oct 23 23:09:22 user nova-compute[74482]:   <name>instance-00000015</name>
Oct 23 23:09:22 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:09:22 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:09:22 user nova-compute[74482]:   <metadata>
Oct 23 23:09:22 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:09:22 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:09:22 user nova-compute[74482]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1137023492</nova:name>
Oct 23 23:09:22 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:09:22</nova:creationTime>
Oct 23 23:09:22 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:09:22 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:09:22 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:09:22 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:09:22 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:09:22 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:09:22 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:09:22 user nova-compute[74482]:       <nova:owner>
Oct 23 23:09:22 user nova-compute[74482]:         <nova:user uuid="4f2f6cc277224a04a377fc0bfc3b5021">tempest-VolumesAdminNegativeTest-1781155714-project-member</nova:user>
Oct 23 23:09:22 user nova-compute[74482]:         <nova:project uuid="98b95877b43e4d458fd124f0ae506aaf">tempest-VolumesAdminNegativeTest-1781155714</nova:project>
Oct 23 23:09:22 user nova-compute[74482]:       </nova:owner>
Oct 23 23:09:22 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:09:22 user nova-compute[74482]:       <nova:ports>
Oct 23 23:09:22 user nova-compute[74482]:         <nova:port uuid="14caf373-8f4a-4b82-80a1-3d55c61cdb6d">
Oct 23 23:09:22 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 23:09:22 user nova-compute[74482]:         </nova:port>
Oct 23 23:09:22 user nova-compute[74482]:       </nova:ports>
Oct 23 23:09:22 user nova-compute[74482]:     </nova:instance>
Oct 23 23:09:22 user nova-compute[74482]:   </metadata>
Oct 23 23:09:22 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:09:22 user nova-compute[74482]:     <system>
Oct 23 23:09:22 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:09:22 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:09:22 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:09:22 user nova-compute[74482]:       <entry name="serial">100db750-f1d1-4823-89e3-0e1089266725</entry>
Oct 23 23:09:22 user nova-compute[74482]:       <entry name="uuid">100db750-f1d1-4823-89e3-0e1089266725</entry>
Oct 23 23:09:22 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:09:22 user nova-compute[74482]:     </system>
Oct 23 23:09:22 user nova-compute[74482]:   </sysinfo>
Oct 23 23:09:22 user nova-compute[74482]:   <os>
Oct 23 23:09:22 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:09:22 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:09:22 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:09:22 user nova-compute[74482]:   </os>
Oct 23 23:09:22 user nova-compute[74482]:   <features>
Oct 23 23:09:22 user nova-compute[74482]:     <acpi/>
Oct 23 23:09:22 user nova-compute[74482]:     <apic/>
Oct 23 23:09:22 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:09:22 user nova-compute[74482]:   </features>
Oct 23 23:09:22 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:09:22 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:09:22 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:09:22 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:09:22 user nova-compute[74482]:   </clock>
Oct 23 23:09:22 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:09:22 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:09:22 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:09:22 user nova-compute[74482]:   </cpu>
Oct 23 23:09:22 user nova-compute[74482]:   <devices>
Oct 23 23:09:22 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:09:22 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:09:22 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk"/>
Oct 23 23:09:22 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:09:22 user nova-compute[74482]:     </disk>
Oct 23 23:09:22 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:09:22 user nova-compute[74482]:       <mac address="fa:16:3e:07:f7:09"/>
Oct 23 23:09:22 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:09:22 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:09:22 user nova-compute[74482]:       <target dev="tap14caf373-8f"/>
Oct 23 23:09:22 user nova-compute[74482]:     </interface>
Oct 23 23:09:22 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:09:22 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/console.log" append="off"/>
Oct 23 23:09:22 user nova-compute[74482]:     </serial>
Oct 23 23:09:22 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:09:22 user nova-compute[74482]:     <video>
Oct 23 23:09:22 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:09:22 user nova-compute[74482]:     </video>
Oct 23 23:09:22 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:09:22 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:09:22 user nova-compute[74482]:     </rng>
Oct 23 23:09:22 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:09:22 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:09:22 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:09:22 user nova-compute[74482]:     </memballoon>
Oct 23 23:09:22 user nova-compute[74482]:   </devices>
Oct 23 23:09:22 user nova-compute[74482]: </domain>
Oct 23 23:09:22 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1137023492',display_name='tempest-VolumesAdminNegativeTest-server-1137023492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1137023492',id=21,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98b95877b43e4d458fd124f0ae506aaf',ramdisk_id='',reservation_id='r-mz62ec6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1781155714',owner_user_name='tempest-VolumesAdminNegativeTest-1781155714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:09:20Z,user_data=None,user_id='4f2f6cc277224a04a377fc0bfc3b5021',uuid=100db750-f1d1-4823-89e3-0e1089266725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "address": "fa:16:3e:07:f7:09", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14caf373-8f", "ovs_interfaceid": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converting VIF {"id": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "address": "fa:16:3e:07:f7:09", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14caf373-8f", "ovs_interfaceid": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f7:09,bridge_name='br-int',has_traffic_filtering=True,id=14caf373-8f4a-4b82-80a1-3d55c61cdb6d,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14caf373-8f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG os_vif [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f7:09,bridge_name='br-int',has_traffic_filtering=True,id=14caf373-8f4a-4b82-80a1-3d55c61cdb6d,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14caf373-8f') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2eb31ae7-f9f5-59b0-aa12-fdb16eebc3ce', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updating instance_info_cache with network_info: [{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14caf373-8f, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14caf373-8f, col_values=(('qos', UUID('ea803b91-3f73-4138-8123-2856baebe0eb')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14caf373-8f, col_values=(('external_ids', {'iface-id': '14caf373-8f4a-4b82-80a1-3d55c61cdb6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:f7:09', 'vm-uuid': '100db750-f1d1-4823-89e3-0e1089266725'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Releasing lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Instance network_info: |[{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9b26eca7-4a84-4850-ab95-b077ff726f8a req-d9e6eca4-fdae-4778-b9da-ae5a8e7281fd service nova] Acquired lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-9b26eca7-4a84-4850-ab95-b077ff726f8a req-d9e6eca4-fdae-4778-b9da-ae5a8e7281fd service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Start _get_guest_xml network_info=[{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T23:09:15Z,direct_url=<?>,disk_format='qcow2',id=5487da70-f1de-4665-a9d6-6b9ab731970f,min_disk=0,min_ram=0,name='tempest-scenario-img--1558464782',owner='cf59ee373fd04ceda1c9212af985f052',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T23:09:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '5487da70-f1de-4665-a9d6-6b9ab731970f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: INFO os_vif [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f7:09,bridge_name='br-int',has_traffic_filtering=True,id=14caf373-8f4a-4b82-80a1-3d55c61cdb6d,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14caf373-8f')
Oct 23 23:09:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:09:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T23:09:15Z,direct_url=<?>,disk_format='qcow2',id=5487da70-f1de-4665-a9d6-6b9ab731970f,min_disk=0,min_ram=0,name='tempest-scenario-img--1558464782',owner='cf59ee373fd04ceda1c9212af985f052',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T23:09:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-950332835',display_name='tempest-TestMinimumBasicScenario-server-950332835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-950332835',id=22,image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG8dgWQuRHRcLtDLX4CB3F97QOTyGUchFE4KCjIBlG9aoZYNxbOzHcdZhg2VJjRM/RAp+PzivptFgF5OTQl2OLvi7mZOYBYkFv0tzEOK5lfUUpR+6KPBIbQ/TraHJ145g==',key_name='tempest-TestMinimumBasicScenario-439322620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf59ee373fd04ceda1c9212af985f052',ramdisk_id='',reservation_id='r-t08kgi8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-964628947',owner_user_name='tempest-TestMinimumBasicScenario-964628947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:09:20Z,user_data=None,user_id='58e1ae75bd484d3ea749e10346671167',uuid=233cb56f-9cce-4c10-94db-cf694a20af1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converting VIF {"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.objects.instance [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'pci_devices' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:09:23 user nova-compute[74482]:   <uuid>233cb56f-9cce-4c10-94db-cf694a20af1f</uuid>
Oct 23 23:09:23 user nova-compute[74482]:   <name>instance-00000016</name>
Oct 23 23:09:23 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:09:23 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:09:23 user nova-compute[74482]:   <metadata>
Oct 23 23:09:23 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:09:23 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:09:23 user nova-compute[74482]:       <nova:name>tempest-TestMinimumBasicScenario-server-950332835</nova:name>
Oct 23 23:09:23 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:09:23</nova:creationTime>
Oct 23 23:09:23 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:09:23 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:09:23 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:09:23 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:09:23 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:09:23 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:09:23 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:09:23 user nova-compute[74482]:       <nova:owner>
Oct 23 23:09:23 user nova-compute[74482]:         <nova:user uuid="58e1ae75bd484d3ea749e10346671167">tempest-TestMinimumBasicScenario-964628947-project-member</nova:user>
Oct 23 23:09:23 user nova-compute[74482]:         <nova:project uuid="cf59ee373fd04ceda1c9212af985f052">tempest-TestMinimumBasicScenario-964628947</nova:project>
Oct 23 23:09:23 user nova-compute[74482]:       </nova:owner>
Oct 23 23:09:23 user nova-compute[74482]:       <nova:root type="image" uuid="5487da70-f1de-4665-a9d6-6b9ab731970f"/>
Oct 23 23:09:23 user nova-compute[74482]:       <nova:ports>
Oct 23 23:09:23 user nova-compute[74482]:         <nova:port uuid="fb4eca63-002e-4eaf-b6ef-f2d6f558f20a">
Oct 23 23:09:23 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 23:09:23 user nova-compute[74482]:         </nova:port>
Oct 23 23:09:23 user nova-compute[74482]:       </nova:ports>
Oct 23 23:09:23 user nova-compute[74482]:     </nova:instance>
Oct 23 23:09:23 user nova-compute[74482]:   </metadata>
Oct 23 23:09:23 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:09:23 user nova-compute[74482]:     <system>
Oct 23 23:09:23 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:09:23 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:09:23 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:09:23 user nova-compute[74482]:       <entry name="serial">233cb56f-9cce-4c10-94db-cf694a20af1f</entry>
Oct 23 23:09:23 user nova-compute[74482]:       <entry name="uuid">233cb56f-9cce-4c10-94db-cf694a20af1f</entry>
Oct 23 23:09:23 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:09:23 user nova-compute[74482]:     </system>
Oct 23 23:09:23 user nova-compute[74482]:   </sysinfo>
Oct 23 23:09:23 user nova-compute[74482]:   <os>
Oct 23 23:09:23 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:09:23 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:09:23 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:09:23 user nova-compute[74482]:   </os>
Oct 23 23:09:23 user nova-compute[74482]:   <features>
Oct 23 23:09:23 user nova-compute[74482]:     <acpi/>
Oct 23 23:09:23 user nova-compute[74482]:     <apic/>
Oct 23 23:09:23 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:09:23 user nova-compute[74482]:   </features>
Oct 23 23:09:23 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:09:23 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:09:23 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:09:23 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:09:23 user nova-compute[74482]:   </clock>
Oct 23 23:09:23 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:09:23 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:09:23 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:09:23 user nova-compute[74482]:   </cpu>
Oct 23 23:09:23 user nova-compute[74482]:   <devices>
Oct 23 23:09:23 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:09:23 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:09:23 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk"/>
Oct 23 23:09:23 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:09:23 user nova-compute[74482]:     </disk>
Oct 23 23:09:23 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:09:23 user nova-compute[74482]:       <mac address="fa:16:3e:ca:2a:fe"/>
Oct 23 23:09:23 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:09:23 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:09:23 user nova-compute[74482]:       <target dev="tapfb4eca63-00"/>
Oct 23 23:09:23 user nova-compute[74482]:     </interface>
Oct 23 23:09:23 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:09:23 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/console.log" append="off"/>
Oct 23 23:09:23 user nova-compute[74482]:     </serial>
Oct 23 23:09:23 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:09:23 user nova-compute[74482]:     <video>
Oct 23 23:09:23 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:09:23 user nova-compute[74482]:     </video>
Oct 23 23:09:23 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:09:23 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:09:23 user nova-compute[74482]:     </rng>
Oct 23 23:09:23 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:09:23 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:09:23 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:09:23 user nova-compute[74482]:     </memballoon>
Oct 23 23:09:23 user nova-compute[74482]:   </devices>
Oct 23 23:09:23 user nova-compute[74482]: </domain>
Oct 23 23:09:23 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-950332835',display_name='tempest-TestMinimumBasicScenario-server-950332835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-950332835',id=22,image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG8dgWQuRHRcLtDLX4CB3F97QOTyGUchFE4KCjIBlG9aoZYNxbOzHcdZhg2VJjRM/RAp+PzivptFgF5OTQl2OLvi7mZOYBYkFv0tzEOK5lfUUpR+6KPBIbQ/TraHJ145g==',key_name='tempest-TestMinimumBasicScenario-439322620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf59ee373fd04ceda1c9212af985f052',ramdisk_id='',reservation_id='r-t08kgi8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-964628947',owner_user_name='tempest-TestMinimumBasicScenario-964628947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:09:20Z,user_data=None,user_id='58e1ae75bd484d3ea749e10346671167',uuid=233cb56f-9cce-4c10-94db-cf694a20af1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converting VIF {"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG os_vif [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fc6be90-3432-5fcf-a7f8-f5d469e0b5c4', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb4eca63-00, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb4eca63-00, col_values=(('qos', UUID('74cc15e3-16ee-4638-ba27-0da86bed232f')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb4eca63-00, col_values=(('external_ids', {'iface-id': 'fb4eca63-002e-4eaf-b6ef-f2d6f558f20a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:2a:fe', 'vm-uuid': '233cb56f-9cce-4c10-94db-cf694a20af1f'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] No VIF found with MAC fa:16:3e:07:f7:09, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: INFO os_vif [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00')
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No VIF found with MAC fa:16:3e:ca:2a:fe, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-9b26eca7-4a84-4850-ab95-b077ff726f8a req-d9e6eca4-fdae-4778-b9da-ae5a8e7281fd service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updated VIF entry in instance network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-9b26eca7-4a84-4850-ab95-b077ff726f8a req-d9e6eca4-fdae-4778-b9da-ae5a8e7281fd service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updating instance_info_cache with network_info: [{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:09:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9b26eca7-4a84-4850-ab95-b077ff726f8a req-d9e6eca4-fdae-4778-b9da-ae5a8e7281fd service nova] Releasing lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Updating instance_info_cache with network_info: [{"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-95802cf3-56ba-4224-a333-e00e54c72166" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-59133bce-f5c0-4e7f-aa8a-57a44b5de18c req-d23032fd-7c7a-4fdf-95ba-0c4579c9aa35 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received event network-vif-plugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59133bce-f5c0-4e7f-aa8a-57a44b5de18c req-d23032fd-7c7a-4fdf-95ba-0c4579c9aa35 service nova] Acquiring lock "100db750-f1d1-4823-89e3-0e1089266725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59133bce-f5c0-4e7f-aa8a-57a44b5de18c req-d23032fd-7c7a-4fdf-95ba-0c4579c9aa35 service nova] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59133bce-f5c0-4e7f-aa8a-57a44b5de18c req-d23032fd-7c7a-4fdf-95ba-0c4579c9aa35 service nova] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-59133bce-f5c0-4e7f-aa8a-57a44b5de18c req-d23032fd-7c7a-4fdf-95ba-0c4579c9aa35 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] No waiting events found dispatching network-vif-plugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:09:26 user nova-compute[74482]: WARNING nova.compute.manager [req-59133bce-f5c0-4e7f-aa8a-57a44b5de18c req-d23032fd-7c7a-4fdf-95ba-0c4579c9aa35 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received unexpected event network-vif-plugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d for instance with vm_state building and task_state spawning.
Oct 23 23:09:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-b3e54820-8235-4235-b503-274974b2308f req-4a390f0e-20fe-4a52-b174-390f182dd6e4 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b3e54820-8235-4235-b503-274974b2308f req-4a390f0e-20fe-4a52-b174-390f182dd6e4 service nova] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b3e54820-8235-4235-b503-274974b2308f req-4a390f0e-20fe-4a52-b174-390f182dd6e4 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b3e54820-8235-4235-b503-274974b2308f req-4a390f0e-20fe-4a52-b174-390f182dd6e4 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-b3e54820-8235-4235-b503-274974b2308f req-4a390f0e-20fe-4a52-b174-390f182dd6e4 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] No waiting events found dispatching network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:09:26 user nova-compute[74482]: WARNING nova.compute.manager [req-b3e54820-8235-4235-b503-274974b2308f req-4a390f0e-20fe-4a52-b174-390f182dd6e4 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received unexpected event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a for instance with vm_state building and task_state spawning.
Oct 23 23:09:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-70662135-f3aa-4b85-b6d3-62b5b6bf4dd5 req-9c9024da-4683-4505-9f8e-975c56f283cb service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received event network-vif-plugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-70662135-f3aa-4b85-b6d3-62b5b6bf4dd5 req-9c9024da-4683-4505-9f8e-975c56f283cb service nova] Acquiring lock "100db750-f1d1-4823-89e3-0e1089266725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-70662135-f3aa-4b85-b6d3-62b5b6bf4dd5 req-9c9024da-4683-4505-9f8e-975c56f283cb service nova] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-70662135-f3aa-4b85-b6d3-62b5b6bf4dd5 req-9c9024da-4683-4505-9f8e-975c56f283cb service nova] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-70662135-f3aa-4b85-b6d3-62b5b6bf4dd5 req-9c9024da-4683-4505-9f8e-975c56f283cb service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] No waiting events found dispatching network-vif-plugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:09:28 user nova-compute[74482]: WARNING nova.compute.manager [req-70662135-f3aa-4b85-b6d3-62b5b6bf4dd5 req-9c9024da-4683-4505-9f8e-975c56f283cb service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received unexpected event network-vif-plugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d for instance with vm_state building and task_state spawning.
Oct 23 23:09:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:09:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Instance spawned successfully.
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-8da88fb8-df6a-40be-9b4a-de594b06caf4 req-6cc9f47d-a384-4045-91d0-838a3d2f536f service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8da88fb8-df6a-40be-9b4a-de594b06caf4 req-6cc9f47d-a384-4045-91d0-838a3d2f536f service nova] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8da88fb8-df6a-40be-9b4a-de594b06caf4 req-6cc9f47d-a384-4045-91d0-838a3d2f536f service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8da88fb8-df6a-40be-9b4a-de594b06caf4 req-6cc9f47d-a384-4045-91d0-838a3d2f536f service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-8da88fb8-df6a-40be-9b4a-de594b06caf4 req-6cc9f47d-a384-4045-91d0-838a3d2f536f service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] No waiting events found dispatching network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:09:28 user nova-compute[74482]: WARNING nova.compute.manager [req-8da88fb8-df6a-40be-9b4a-de594b06caf4 req-6cc9f47d-a384-4045-91d0-838a3d2f536f service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received unexpected event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a for instance with vm_state building and task_state spawning.
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: INFO nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Took 8.05 seconds to spawn the instance on the hypervisor.
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:09:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Instance spawned successfully.
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:09:28 user nova-compute[74482]: INFO nova.compute.manager [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Took 9.91 seconds to build instance.
Oct 23 23:09:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-08e3efc6-d64a-415c-af5d-dce1b16746c8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.073s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:09:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:28 user nova-compute[74482]: INFO nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Took 9.19 seconds to spawn the instance on the hypervisor.
Oct 23 23:09:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:29 user nova-compute[74482]: INFO nova.compute.manager [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Took 10.35 seconds to build instance.
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e63c7fe-bc5f-4dbe-96e7-689c2824253e tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "100db750-f1d1-4823-89e3-0e1089266725" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.456s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:35 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:09:35 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7384MB free_disk=25.018802642822266GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2a91897d-e83c-4396-8584-c8ff4fcfc553 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 1718ea62-105b-44ac-80f6-587224314449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance a18c958b-f7d9-47ba-ad98-332e12838d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 599b9f36-af3c-405a-ae1d-088325a1fa03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 100db750-f1d1-4823-89e3-0e1089266725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 233cb56f-9cce-4c10-94db-cf694a20af1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:09:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:36 user nova-compute[74482]: DEBUG nova.compute.manager [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:09:36 user nova-compute[74482]: INFO nova.compute.manager [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] instance snapshotting
Oct 23 23:09:36 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Beginning live snapshot process
Oct 23 23:09:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json -f qcow2 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json -f qcow2 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm23k5ac9/22a1c9f778c341a8b2f61e933ed70254.delta 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpm23k5ac9/22a1c9f778c341a8b2f61e933ed70254.delta 1073741824" returned: 0 in 0.047s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:37 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 23:09:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:09:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:09:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 23:09:39 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:09:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm23k5ac9/22a1c9f778c341a8b2f61e933ed70254.delta /opt/stack/data/nova/instances/snapshots/tmpm23k5ac9/22a1c9f778c341a8b2f61e933ed70254 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpm23k5ac9/22a1c9f778c341a8b2f61e933ed70254.delta /opt/stack/data/nova/instances/snapshots/tmpm23k5ac9/22a1c9f778c341a8b2f61e933ed70254" returned: 0 in 0.800s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:40 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Snapshot extracted, beginning image upload
Oct 23 23:09:43 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Snapshot image upload complete
Oct 23 23:09:43 user nova-compute[74482]: INFO nova.compute.manager [None req-23802596-9b3f-4ea5-b1c9-3bc9f4a47297 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Took 6.23 seconds to snapshot the instance on the hypervisor.
Oct 23 23:09:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:49 user nova-compute[74482]: INFO nova.compute.manager [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Terminating instance
Oct 23 23:09:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-8649d0b3-a8f8-4ea4-bdc3-8d52981a34d4 req-a8a417d2-7697-4ebe-b787-35f239cc23f6 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-unplugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8649d0b3-a8f8-4ea4-bdc3-8d52981a34d4 req-a8a417d2-7697-4ebe-b787-35f239cc23f6 service nova] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8649d0b3-a8f8-4ea4-bdc3-8d52981a34d4 req-a8a417d2-7697-4ebe-b787-35f239cc23f6 service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8649d0b3-a8f8-4ea4-bdc3-8d52981a34d4 req-a8a417d2-7697-4ebe-b787-35f239cc23f6 service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-8649d0b3-a8f8-4ea4-bdc3-8d52981a34d4 req-a8a417d2-7697-4ebe-b787-35f239cc23f6 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] No waiting events found dispatching network-vif-unplugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-8649d0b3-a8f8-4ea4-bdc3-8d52981a34d4 req-a8a417d2-7697-4ebe-b787-35f239cc23f6 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-unplugged-f4d3d364-6576-469e-b136-32509ea1bef0 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-ffda809a-fba3-4c07-8f24-f4ac150fbde0 req-8b7039df-6146-445a-bc96-dcfe56d0f465 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-changed-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-ffda809a-fba3-4c07-8f24-f4ac150fbde0 req-8b7039df-6146-445a-bc96-dcfe56d0f465 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Refreshing instance network info cache due to event network-changed-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ffda809a-fba3-4c07-8f24-f4ac150fbde0 req-8b7039df-6146-445a-bc96-dcfe56d0f465 service nova] Acquiring lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ffda809a-fba3-4c07-8f24-f4ac150fbde0 req-8b7039df-6146-445a-bc96-dcfe56d0f465 service nova] Acquired lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.network.neutron [req-ffda809a-fba3-4c07-8f24-f4ac150fbde0 req-8b7039df-6146-445a-bc96-dcfe56d0f465 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Refreshing network info cache for port e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:09:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Instance destroyed successfully.
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.objects.instance [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'resources' on Instance uuid 2a91897d-e83c-4396-8584-c8ff4fcfc553 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:03:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1405955470',display_name='tempest-ServerActionsTestOtherA-server-466596655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1405955470',id=13,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+kFDD4wwJWW/1hObOOzjmoSpoVE08++Rl7M3rZ7hasNILrz2Hts0rh2BR+TeMo8ArCwaM5O7vBiIcCD76Cv0A5UMS3pbhQxU/biWWpIfcmTYASw0GYH12Hz9/vT8pENw==',key_name='tempest-keypair-25770726',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:06:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-wps4jnhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=2a91897d-e83c-4396-8584-c8ff4fcfc553,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "f4d3d364-6576-469e-b136-32509ea1bef0", "address": "fa:16:3e:68:49:59", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d3d364-65", "ovs_interfaceid": "f4d3d364-6576-469e-b136-32509ea1bef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG os_vif [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4d3d364-65, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb30e839-20a1-470b-8705-43b4e6b71c44) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:50 user nova-compute[74482]: INFO os_vif [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:49:59,bridge_name='br-int',has_traffic_filtering=True,id=f4d3d364-6576-469e-b136-32509ea1bef0,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d3d364-65')
Oct 23 23:09:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Deleting instance files /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553_del
Oct 23 23:09:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Deletion of /opt/stack/data/nova/instances/2a91897d-e83c-4396-8584-c8ff4fcfc553_del complete
Oct 23 23:09:50 user nova-compute[74482]: INFO nova.compute.manager [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 23 23:09:50 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:09:50 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG nova.objects.instance [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'flavor' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-ffda809a-fba3-4c07-8f24-f4ac150fbde0 req-8b7039df-6146-445a-bc96-dcfe56d0f465 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updated VIF entry in instance network info cache for port e28ce78b-2583-4ef4-a071-d3b25fc5a3ea. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-ffda809a-fba3-4c07-8f24-f4ac150fbde0 req-8b7039df-6146-445a-bc96-dcfe56d0f465 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updating instance_info_cache with network_info: [{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ffda809a-fba3-4c07-8f24-f4ac150fbde0 req-8b7039df-6146-445a-bc96-dcfe56d0f465 service nova] Releasing lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:51 user nova-compute[74482]: INFO nova.compute.manager [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Attaching volume 96d06894-5c49-4ccb-a339-fd1fd5eb9a3a to /dev/vdb
Oct 23 23:09:51 user nova-compute[74482]: DEBUG os_brick.utils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[679a997c-9839-4805-90ff-a43e6b08b694]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[17852b96-5c4f-4c2c-ac56-b7125ba46491]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[00096eaf-bb81-4b94-87ff-624170b1ddf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5478b3ad-eada-44ac-8256-7facbc4969d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:09:51 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:09:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e0dfd-3f7d-4625-ba04-5db989d35069]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG os_brick.utils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:09:51 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updating existing volume attachment record: 38be9d8c-5a25-46ce-b751-d94cb92c50f5 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:09:52 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Took 1.24 seconds to deallocate network for instance.
Oct 23 23:09:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-7face426-fd90-44dd-abda-8d7e49579c28 req-b9dbae0b-d6ae-4f9f-8af8-6b3c322b0cb7 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7face426-fd90-44dd-abda-8d7e49579c28 req-b9dbae0b-d6ae-4f9f-8af8-6b3c322b0cb7 service nova] Acquiring lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7face426-fd90-44dd-abda-8d7e49579c28 req-b9dbae0b-d6ae-4f9f-8af8-6b3c322b0cb7 service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7face426-fd90-44dd-abda-8d7e49579c28 req-b9dbae0b-d6ae-4f9f-8af8-6b3c322b0cb7 service nova] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-7face426-fd90-44dd-abda-8d7e49579c28 req-b9dbae0b-d6ae-4f9f-8af8-6b3c322b0cb7 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] No waiting events found dispatching network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:09:52 user nova-compute[74482]: WARNING nova.compute.manager [req-7face426-fd90-44dd-abda-8d7e49579c28 req-b9dbae0b-d6ae-4f9f-8af8-6b3c322b0cb7 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received unexpected event network-vif-plugged-f4d3d364-6576-469e-b136-32509ea1bef0 for instance with vm_state deleted and task_state None.
Oct 23 23:09:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-7face426-fd90-44dd-abda-8d7e49579c28 req-b9dbae0b-d6ae-4f9f-8af8-6b3c322b0cb7 service nova] [instance: 2a91897d-e83c-4396-8584-c8ff4fcfc553] Received event network-vif-deleted-f4d3d364-6576-469e-b136-32509ea1bef0 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:09:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:52 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Deleted allocations for instance 2a91897d-e83c-4396-8584-c8ff4fcfc553
Oct 23 23:09:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-90f743e1-81f9-4abc-88c9-a73ff54d8c25 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "2a91897d-e83c-4396-8584-c8ff4fcfc553" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.033s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:09:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:09:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-128cca96-1d5f-42b3-b012-23465a977b9c req-6ec82aca-8dd7-454f-ac9b-121c645a5052 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received event network-changed-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:10:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-128cca96-1d5f-42b3-b012-23465a977b9c req-6ec82aca-8dd7-454f-ac9b-121c645a5052 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Refreshing instance network info cache due to event network-changed-1429e61f-b7da-46a7-a714-d6c68b8b8c5f. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:10:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-128cca96-1d5f-42b3-b012-23465a977b9c req-6ec82aca-8dd7-454f-ac9b-121c645a5052 service nova] Acquiring lock "refresh_cache-599b9f36-af3c-405a-ae1d-088325a1fa03" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:10:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-128cca96-1d5f-42b3-b012-23465a977b9c req-6ec82aca-8dd7-454f-ac9b-121c645a5052 service nova] Acquired lock "refresh_cache-599b9f36-af3c-405a-ae1d-088325a1fa03" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:10:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-128cca96-1d5f-42b3-b012-23465a977b9c req-6ec82aca-8dd7-454f-ac9b-121c645a5052 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Refreshing network info cache for port 1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG nova.network.neutron [req-128cca96-1d5f-42b3-b012-23465a977b9c req-6ec82aca-8dd7-454f-ac9b-121c645a5052 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Updated VIF entry in instance network info cache for port 1429e61f-b7da-46a7-a714-d6c68b8b8c5f. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG nova.network.neutron [req-128cca96-1d5f-42b3-b012-23465a977b9c req-6ec82aca-8dd7-454f-ac9b-121c645a5052 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Updating instance_info_cache with network_info: [{"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-128cca96-1d5f-42b3-b012-23465a977b9c req-6ec82aca-8dd7-454f-ac9b-121c645a5052 service nova] Releasing lock "refresh_cache-599b9f36-af3c-405a-ae1d-088325a1fa03" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lazy-loading 'flavor' on Instance uuid 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:06 user nova-compute[74482]: INFO nova.compute.manager [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Attaching volume cfa348b2-75f3-40a2-81f9-c03e90ca153c to /dev/vdb
Oct 23 23:10:06 user nova-compute[74482]: DEBUG os_brick.utils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c86d307-1814-4d91-a253-77137fb9ad35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aa8156-11ed-45e5-9017-4fb6b8d27538]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab6de48-35fa-4cb5-b11b-c5fe7cb97cad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04e529-56a9-41bf-a456-79ae00b7811b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:10:06 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[893cbe8f-e6fe-40fb-bcfe-005b57658d71]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG os_brick.utils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Updating existing volume attachment record: 1dd5c37e-9095-4b21-93fe-1bbe5c71cc44 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:10:06 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:10:07 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updating instance_info_cache with network_info: [{"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:10:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:10:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:10:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:10:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtsvyumU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:10:10 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:10:10 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:10:10 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[253fd20e-565f-48f3-b53c-7b8ed8ddd747]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:10:10 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e590d70b-c6f4-43ee-a69a-df1417e9cc5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a] added
Oct 23 23:10:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9a00f2-85d5-4a82-b43c-35cad79c8ab0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeafcdc-443a-4505-a858-5ff88c3e81fb]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtsvyumU {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtsvyumU" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f20ea0-d760-44f3-8580-16d44476ac52]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FtsvyumU'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d2cfff-88e6-43f3-a40f-f27585db44a4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f88e294-1bcf-4834-8221-1fbb003b6377]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:10 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:10 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e857709-09c7-40e5-9790-fe52148dc8b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a, portal: 172.16.0.220,3260]
Oct 23 23:10:10 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a, portal: 172.16.0.220,3260] successful.
Oct 23 23:10:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8edc23-6396-4280-8f2c-781e0d73001c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd340d0a-7e02-4439-be91-1f2562305543]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:10 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:10 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:10 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:10 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3b02e9-7b7b-4e32-a95b-e5c91a6ede44]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtsvyumU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:10:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:10:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23162356131353633', 'path': '/dev/sdd'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:10:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162356131353633', 'path': '/dev/sdd'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:10:11 user nova-compute[74482]: DEBUG nova.objects.instance [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'flavor' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:10:11 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:10:11 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:10:11 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:10:11 user nova-compute[74482]:   <serial>96d06894-5c49-4ccb-a339-fd1fd5eb9a3a</serial>
Oct 23 23:10:11 user nova-compute[74482]: </disk>
Oct 23 23:10:11 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:10:11 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No VIF found with MAC fa:16:3e:1b:84:96, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:10:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5d51afb4-8bbe-441f-975f-837ba38960bf tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.760s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:12 user nova-compute[74482]: INFO nova.compute.manager [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Rescuing
Oct 23 23:10:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:10:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquired lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:10:12 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:10:12 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updating instance_info_cache with network_info: [{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:10:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Releasing lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-e604b431-75c5-49ac-a346-bb93be048a6e req-8385b010-fed7-4840-a6e4-4a1f1da79669 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-unplugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e604b431-75c5-49ac-a346-bb93be048a6e req-8385b010-fed7-4840-a6e4-4a1f1da79669 service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e604b431-75c5-49ac-a346-bb93be048a6e req-8385b010-fed7-4840-a6e4-4a1f1da79669 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e604b431-75c5-49ac-a346-bb93be048a6e req-8385b010-fed7-4840-a6e4-4a1f1da79669 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-e604b431-75c5-49ac-a346-bb93be048a6e req-8385b010-fed7-4840-a6e4-4a1f1da79669 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-unplugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:10:13 user nova-compute[74482]: WARNING nova.compute.manager [req-e604b431-75c5-49ac-a346-bb93be048a6e req-8385b010-fed7-4840-a6e4-4a1f1da79669 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-unplugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state active and task_state rescuing.
Oct 23 23:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Instance destroyed successfully.
Oct 23 23:10:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Attempting rescue
Oct 23 23:10:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Instance directory exists: not creating {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 23:10:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Creating image(s)
Oct 23 23:10:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'trusted_certs' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue" returned: 0 in 0.053s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'migration_context' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.base [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<03e1e9cb-0954-444f-baf5-cb2e2acd4b3b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Start _get_guest_xml network_info=[{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "vif_mac": "fa:16:3e:1b:84:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8269c4ae-64d4-478e-8976-b601953bda88', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'resources' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.base [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<03e1e9cb-0954-444f-baf5-cb2e2acd4b3b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'numa_topology' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.base [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<03e1e9cb-0954-444f-baf5-cb2e2acd4b3b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:10:14 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:10:14 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.base [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<03e1e9cb-0954-444f-baf5-cb2e2acd4b3b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1964417688',display_name='tempest-ServerRescueNegativeTestJSON-server-1964417688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1964417688',id=19,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT8VqUMB8rnh10l+ySFNmiC2m4ZblMqqwo0Xr/8hHga0olsqbmgYn1OrZ6ijsuJti0TkZOcVMOb7g9Pg4J6If3LXbS2hyryUQidVH8jZIQprpVD549e3rW+HR7Pt7DDSA==',key_name='tempest-keypair-20632901',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-8d8965bs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=03e1e9cb-0954-444f-baf5-cb2e2acd4b3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "vif_mac": "fa:16:3e:1b:84:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "vif_mac": "fa:16:3e:1b:84:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:84:96,bridge_name='br-int',has_traffic_filtering=True,id=e28ce78b-2583-4ef4-a071-d3b25fc5a3ea,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28ce78b-25') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'pci_devices' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.objects.base [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Object Instance<03e1e9cb-0954-444f-baf5-cb2e2acd4b3b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:10:14 user nova-compute[74482]:   <uuid>03e1e9cb-0954-444f-baf5-cb2e2acd4b3b</uuid>
Oct 23 23:10:14 user nova-compute[74482]:   <name>instance-00000013</name>
Oct 23 23:10:14 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:10:14 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:10:14 user nova-compute[74482]:   <metadata>
Oct 23 23:10:14 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:10:14 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:10:14 user nova-compute[74482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1964417688</nova:name>
Oct 23 23:10:14 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:10:14</nova:creationTime>
Oct 23 23:10:14 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:10:14 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:10:14 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:10:14 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:10:14 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:10:14 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:10:14 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:10:14 user nova-compute[74482]:       <nova:owner>
Oct 23 23:10:14 user nova-compute[74482]:         <nova:user uuid="2dfe9260c1b8446fbcda07a9dcfa65fb">tempest-ServerRescueNegativeTestJSON-1888569284-project-member</nova:user>
Oct 23 23:10:14 user nova-compute[74482]:         <nova:project uuid="c07328e2befa472d804361a59ac16829">tempest-ServerRescueNegativeTestJSON-1888569284</nova:project>
Oct 23 23:10:14 user nova-compute[74482]:       </nova:owner>
Oct 23 23:10:14 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:10:14 user nova-compute[74482]:       <nova:ports>
Oct 23 23:10:14 user nova-compute[74482]:         <nova:port uuid="e28ce78b-2583-4ef4-a071-d3b25fc5a3ea">
Oct 23 23:10:14 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 23:10:14 user nova-compute[74482]:         </nova:port>
Oct 23 23:10:14 user nova-compute[74482]:       </nova:ports>
Oct 23 23:10:14 user nova-compute[74482]:     </nova:instance>
Oct 23 23:10:14 user nova-compute[74482]:   </metadata>
Oct 23 23:10:14 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:10:14 user nova-compute[74482]:     <system>
Oct 23 23:10:14 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:10:14 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:10:14 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:10:14 user nova-compute[74482]:       <entry name="serial">03e1e9cb-0954-444f-baf5-cb2e2acd4b3b</entry>
Oct 23 23:10:14 user nova-compute[74482]:       <entry name="uuid">03e1e9cb-0954-444f-baf5-cb2e2acd4b3b</entry>
Oct 23 23:10:14 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:10:14 user nova-compute[74482]:     </system>
Oct 23 23:10:14 user nova-compute[74482]:   </sysinfo>
Oct 23 23:10:14 user nova-compute[74482]:   <os>
Oct 23 23:10:14 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:10:14 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:10:14 user nova-compute[74482]:   </os>
Oct 23 23:10:14 user nova-compute[74482]:   <features>
Oct 23 23:10:14 user nova-compute[74482]:     <acpi/>
Oct 23 23:10:14 user nova-compute[74482]:     <apic/>
Oct 23 23:10:14 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:10:14 user nova-compute[74482]:   </features>
Oct 23 23:10:14 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:10:14 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:10:14 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:10:14 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:10:14 user nova-compute[74482]:   </clock>
Oct 23 23:10:14 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:10:14 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:10:14 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:10:14 user nova-compute[74482]:   </cpu>
Oct 23 23:10:14 user nova-compute[74482]:   <devices>
Oct 23 23:10:14 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:10:14 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:10:14 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue"/>
Oct 23 23:10:14 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:10:14 user nova-compute[74482]:     </disk>
Oct 23 23:10:14 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:10:14 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:10:14 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk"/>
Oct 23 23:10:14 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:10:14 user nova-compute[74482]:     </disk>
Oct 23 23:10:14 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:10:14 user nova-compute[74482]:       <mac address="fa:16:3e:1b:84:96"/>
Oct 23 23:10:14 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:10:14 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:10:14 user nova-compute[74482]:       <target dev="tape28ce78b-25"/>
Oct 23 23:10:14 user nova-compute[74482]:     </interface>
Oct 23 23:10:14 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:10:14 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/console.log" append="off"/>
Oct 23 23:10:14 user nova-compute[74482]:     </serial>
Oct 23 23:10:14 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:10:14 user nova-compute[74482]:     <video>
Oct 23 23:10:14 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:10:14 user nova-compute[74482]:     </video>
Oct 23 23:10:14 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:10:14 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:10:14 user nova-compute[74482]:     </rng>
Oct 23 23:10:14 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:10:14 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:10:14 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:10:14 user nova-compute[74482]:     </memballoon>
Oct 23 23:10:14 user nova-compute[74482]:   </devices>
Oct 23 23:10:14 user nova-compute[74482]: </domain>
Oct 23 23:10:14 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:10:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Instance destroyed successfully.
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] No VIF found with MAC fa:16:3e:1b:84:96, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-8bc45961-de73-437a-a830-19e1e931ba05 req-21ac4974-e254-4cb6-8804-affe62f950ec service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8bc45961-de73-437a-a830-19e1e931ba05 req-21ac4974-e254-4cb6-8804-affe62f950ec service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8bc45961-de73-437a-a830-19e1e931ba05 req-21ac4974-e254-4cb6-8804-affe62f950ec service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8bc45961-de73-437a-a830-19e1e931ba05 req-21ac4974-e254-4cb6-8804-affe62f950ec service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-8bc45961-de73-437a-a830-19e1e931ba05 req-21ac4974-e254-4cb6-8804-affe62f950ec service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:10:15 user nova-compute[74482]: WARNING nova.compute.manager [req-8bc45961-de73-437a-a830-19e1e931ba05 req-21ac4974-e254-4cb6-8804-affe62f950ec service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state active and task_state rescuing.
Oct 23 23:10:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:10:17 user nova-compute[74482]: WARNING nova.compute.manager [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state active and task_state rescuing.
Oct 23 23:10:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:10:17 user nova-compute[74482]: WARNING nova.compute.manager [req-0cb9e755-7079-4bcc-8fe3-eb445a46239e req-6abaabe5-fcfd-4f9a-a4df-1a9496c15040 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state active and task_state rescuing.
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:17 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:10:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e4ccf50f-24e1-44ee-ab08-9d26362e99a7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:10:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:10:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:10:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:10:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:10:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7338MB free_disk=24.928791046142578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:10:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 1718ea62-105b-44ac-80f6-587224314449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance a18c958b-f7d9-47ba-ad98-332e12838d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 599b9f36-af3c-405a-ae1d-088325a1fa03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 100db750-f1d1-4823-89e3-0e1089266725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 233cb56f-9cce-4c10-94db-cf694a20af1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.914s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:10:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquiring lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:10:25 user nova-compute[74482]: INFO nova.compute.claims [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Claim successful on node user
Oct 23 23:10:25 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG nova.network.neutron [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:10:25 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:10:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:10:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:10:26 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Creating image(s)
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "/opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "/opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG nova.policy [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f56901e4ad5741af889eaf09f2702180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a466819e0f4beda1d8eb2e135dcfa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.213s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.236s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk 1073741824" returned: 0 in 0.063s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:26 user nova-compute[74482]: DEBUG nova.network.neutron [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Successfully created port: 28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Cannot resize image /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Ensure instance console log exists: /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.network.neutron [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Successfully updated port: 28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquiring lock "refresh_cache-ca2ec70c-36af-46dd-ae94-2abdd17df8ef" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquired lock "refresh_cache-ca2ec70c-36af-46dd-ae94-2abdd17df8ef" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.network.neutron [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-4a9b6c29-d6b3-4ee0-b8d9-e637a5481510 req-abd222e5-c81f-427f-91ea-992eefb28be7 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received event network-changed-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-4a9b6c29-d6b3-4ee0-b8d9-e637a5481510 req-abd222e5-c81f-427f-91ea-992eefb28be7 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Refreshing instance network info cache due to event network-changed-28e912ad-1286-4d27-8b11-6ebb5c68338c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4a9b6c29-d6b3-4ee0-b8d9-e637a5481510 req-abd222e5-c81f-427f-91ea-992eefb28be7 service nova] Acquiring lock "refresh_cache-ca2ec70c-36af-46dd-ae94-2abdd17df8ef" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.network.neutron [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.network.neutron [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Updating instance_info_cache with network_info: [{"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Releasing lock "refresh_cache-ca2ec70c-36af-46dd-ae94-2abdd17df8ef" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Instance network_info: |[{"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4a9b6c29-d6b3-4ee0-b8d9-e637a5481510 req-abd222e5-c81f-427f-91ea-992eefb28be7 service nova] Acquired lock "refresh_cache-ca2ec70c-36af-46dd-ae94-2abdd17df8ef" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.network.neutron [req-4a9b6c29-d6b3-4ee0-b8d9-e637a5481510 req-abd222e5-c81f-427f-91ea-992eefb28be7 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Refreshing network info cache for port 28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Start _get_guest_xml network_info=[{"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:10:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:10:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-330894725',display_name='tempest-VolumesNegativeTest-instance-330894725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-330894725',id=23,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a466819e0f4beda1d8eb2e135dcfa0',ramdisk_id='',reservation_id='r-s1txjx04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-480598879',owner_user_name='tempest-VolumesNegativeTest-480598879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:10:26Z,user_data=None,user_id='f56901e4ad5741af889eaf09f2702180',uuid=ca2ec70c-36af-46dd-ae94-2abdd17df8ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Converting VIF {"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=28e912ad-1286-4d27-8b11-6ebb5c68338c,network=Network(ab963021-8191-4463-9b81-aedf540ca295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e912ad-12') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lazy-loading 'pci_devices' on Instance uuid ca2ec70c-36af-46dd-ae94-2abdd17df8ef {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:10:27 user nova-compute[74482]:   <uuid>ca2ec70c-36af-46dd-ae94-2abdd17df8ef</uuid>
Oct 23 23:10:27 user nova-compute[74482]:   <name>instance-00000017</name>
Oct 23 23:10:27 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:10:27 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:10:27 user nova-compute[74482]:   <metadata>
Oct 23 23:10:27 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:10:27 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:10:27 user nova-compute[74482]:       <nova:name>tempest-VolumesNegativeTest-instance-330894725</nova:name>
Oct 23 23:10:27 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:10:27</nova:creationTime>
Oct 23 23:10:27 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:10:27 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:10:27 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:10:27 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:10:27 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:10:27 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:10:27 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:10:27 user nova-compute[74482]:       <nova:owner>
Oct 23 23:10:27 user nova-compute[74482]:         <nova:user uuid="f56901e4ad5741af889eaf09f2702180">tempest-VolumesNegativeTest-480598879-project-member</nova:user>
Oct 23 23:10:27 user nova-compute[74482]:         <nova:project uuid="11a466819e0f4beda1d8eb2e135dcfa0">tempest-VolumesNegativeTest-480598879</nova:project>
Oct 23 23:10:27 user nova-compute[74482]:       </nova:owner>
Oct 23 23:10:27 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:10:27 user nova-compute[74482]:       <nova:ports>
Oct 23 23:10:27 user nova-compute[74482]:         <nova:port uuid="28e912ad-1286-4d27-8b11-6ebb5c68338c">
Oct 23 23:10:27 user nova-compute[74482]:           <nova:ip type="fixed" address="192.168.233.190" ipVersion="4"/>
Oct 23 23:10:27 user nova-compute[74482]:         </nova:port>
Oct 23 23:10:27 user nova-compute[74482]:       </nova:ports>
Oct 23 23:10:27 user nova-compute[74482]:     </nova:instance>
Oct 23 23:10:27 user nova-compute[74482]:   </metadata>
Oct 23 23:10:27 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:10:27 user nova-compute[74482]:     <system>
Oct 23 23:10:27 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:10:27 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:10:27 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:10:27 user nova-compute[74482]:       <entry name="serial">ca2ec70c-36af-46dd-ae94-2abdd17df8ef</entry>
Oct 23 23:10:27 user nova-compute[74482]:       <entry name="uuid">ca2ec70c-36af-46dd-ae94-2abdd17df8ef</entry>
Oct 23 23:10:27 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:10:27 user nova-compute[74482]:     </system>
Oct 23 23:10:27 user nova-compute[74482]:   </sysinfo>
Oct 23 23:10:27 user nova-compute[74482]:   <os>
Oct 23 23:10:27 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:10:27 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:10:27 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:10:27 user nova-compute[74482]:   </os>
Oct 23 23:10:27 user nova-compute[74482]:   <features>
Oct 23 23:10:27 user nova-compute[74482]:     <acpi/>
Oct 23 23:10:27 user nova-compute[74482]:     <apic/>
Oct 23 23:10:27 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:10:27 user nova-compute[74482]:   </features>
Oct 23 23:10:27 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:10:27 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:10:27 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:10:27 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:10:27 user nova-compute[74482]:   </clock>
Oct 23 23:10:27 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:10:27 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:10:27 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:10:27 user nova-compute[74482]:   </cpu>
Oct 23 23:10:27 user nova-compute[74482]:   <devices>
Oct 23 23:10:27 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:10:27 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:10:27 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk"/>
Oct 23 23:10:27 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:10:27 user nova-compute[74482]:     </disk>
Oct 23 23:10:27 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:10:27 user nova-compute[74482]:       <mac address="fa:16:3e:17:a7:5d"/>
Oct 23 23:10:27 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:10:27 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:10:27 user nova-compute[74482]:       <target dev="tap28e912ad-12"/>
Oct 23 23:10:27 user nova-compute[74482]:     </interface>
Oct 23 23:10:27 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:10:27 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/console.log" append="off"/>
Oct 23 23:10:27 user nova-compute[74482]:     </serial>
Oct 23 23:10:27 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:10:27 user nova-compute[74482]:     <video>
Oct 23 23:10:27 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:10:27 user nova-compute[74482]:     </video>
Oct 23 23:10:27 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:10:27 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:10:27 user nova-compute[74482]:     </rng>
Oct 23 23:10:27 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:10:27 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:10:27 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:10:27 user nova-compute[74482]:     </memballoon>
Oct 23 23:10:27 user nova-compute[74482]:   </devices>
Oct 23 23:10:27 user nova-compute[74482]: </domain>
Oct 23 23:10:27 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-330894725',display_name='tempest-VolumesNegativeTest-instance-330894725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-330894725',id=23,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11a466819e0f4beda1d8eb2e135dcfa0',ramdisk_id='',reservation_id='r-s1txjx04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-480598879',owner_user_name='tempest-VolumesNegativeTest-480598879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:10:26Z,user_data=None,user_id='f56901e4ad5741af889eaf09f2702180',uuid=ca2ec70c-36af-46dd-ae94-2abdd17df8ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Converting VIF {"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=28e912ad-1286-4d27-8b11-6ebb5c68338c,network=Network(ab963021-8191-4463-9b81-aedf540ca295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e912ad-12') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG os_vif [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=28e912ad-1286-4d27-8b11-6ebb5c68338c,network=Network(ab963021-8191-4463-9b81-aedf540ca295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e912ad-12') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b35f207-fc61-59d6-aaa2-97fa463d7e7c', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28e912ad-12, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28e912ad-12, col_values=(('qos', UUID('819c458f-7ccc-452b-9416-db5b2fb5afbf')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28e912ad-12, col_values=(('external_ids', {'iface-id': '28e912ad-1286-4d27-8b11-6ebb5c68338c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:a7:5d', 'vm-uuid': 'ca2ec70c-36af-46dd-ae94-2abdd17df8ef'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:28 user nova-compute[74482]: INFO os_vif [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=28e912ad-1286-4d27-8b11-6ebb5c68338c,network=Network(ab963021-8191-4463-9b81-aedf540ca295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e912ad-12')
Oct 23 23:10:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] No VIF found with MAC fa:16:3e:17:a7:5d, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG nova.network.neutron [req-4a9b6c29-d6b3-4ee0-b8d9-e637a5481510 req-abd222e5-c81f-427f-91ea-992eefb28be7 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Updated VIF entry in instance network info cache for port 28e912ad-1286-4d27-8b11-6ebb5c68338c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG nova.network.neutron [req-4a9b6c29-d6b3-4ee0-b8d9-e637a5481510 req-abd222e5-c81f-427f-91ea-992eefb28be7 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Updating instance_info_cache with network_info: [{"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:10:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4a9b6c29-d6b3-4ee0-b8d9-e637a5481510 req-abd222e5-c81f-427f-91ea-992eefb28be7 service nova] Releasing lock "refresh_cache-ca2ec70c-36af-46dd-ae94-2abdd17df8ef" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:10:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-53a4de53-ed9e-4aa2-8668-63bee227dcb3 req-856d0281-a2b0-4ac7-8d54-3a4801d49413 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received event network-vif-plugged-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:10:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-53a4de53-ed9e-4aa2-8668-63bee227dcb3 req-856d0281-a2b0-4ac7-8d54-3a4801d49413 service nova] Acquiring lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-53a4de53-ed9e-4aa2-8668-63bee227dcb3 req-856d0281-a2b0-4ac7-8d54-3a4801d49413 service nova] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-53a4de53-ed9e-4aa2-8668-63bee227dcb3 req-856d0281-a2b0-4ac7-8d54-3a4801d49413 service nova] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-53a4de53-ed9e-4aa2-8668-63bee227dcb3 req-856d0281-a2b0-4ac7-8d54-3a4801d49413 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] No waiting events found dispatching network-vif-plugged-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:10:29 user nova-compute[74482]: WARNING nova.compute.manager [req-53a4de53-ed9e-4aa2-8668-63bee227dcb3 req-856d0281-a2b0-4ac7-8d54-3a4801d49413 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received unexpected event network-vif-plugged-28e912ad-1286-4d27-8b11-6ebb5c68338c for instance with vm_state building and task_state spawning.
Oct 23 23:10:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVgsGBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:10:30 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:10:30 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:10:30 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c820d0f2-a6d9-4112-a8dc-5f2644c87650]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:10:30 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc7a78d-e6aa-4d41-a799-8d91993d8fb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c] added
Oct 23 23:10:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bb5e79-2aae-48b9-a262-611a499076d7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0fbde6-2317-4851-b034-6a518478f276]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWVgsGBE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWVgsGBE" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93564ebd-2aa7-4c94-9471-0591bcb548c2]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HWVgsGBE'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[118a31dd-ffde-43c8-99f1-642ec67a9ae6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a83157b-01b7-4bc7-9dd0-97568be4b03d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee7726-a219-429d-ade9-d7a0d6795dcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c, portal: 172.16.0.220,3260]
Oct 23 23:10:30 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c, portal: 172.16.0.220,3260] successful.
Oct 23 23:10:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[04763131-69d2-4433-adda-5e716723f081]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d43c8e3-0b3f-4c1e-88d9-30adbf434615]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:10:30 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[33168a20-117b-48a5-a510-004f3fcefe93]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:10:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVgsGBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:10:31 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Instance spawned successfully.
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-a3418931-5aea-429c-84af-3eeba13f310d req-05807014-d546-4046-8365-1a2059ba3972 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received event network-vif-plugged-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a3418931-5aea-429c-84af-3eeba13f310d req-05807014-d546-4046-8365-1a2059ba3972 service nova] Acquiring lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a3418931-5aea-429c-84af-3eeba13f310d req-05807014-d546-4046-8365-1a2059ba3972 service nova] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a3418931-5aea-429c-84af-3eeba13f310d req-05807014-d546-4046-8365-1a2059ba3972 service nova] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-a3418931-5aea-429c-84af-3eeba13f310d req-05807014-d546-4046-8365-1a2059ba3972 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] No waiting events found dispatching network-vif-plugged-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:10:31 user nova-compute[74482]: WARNING nova.compute.manager [req-a3418931-5aea-429c-84af-3eeba13f310d req-05807014-d546-4046-8365-1a2059ba3972 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received unexpected event network-vif-plugged-28e912ad-1286-4d27-8b11-6ebb5c68338c for instance with vm_state building and task_state spawning.
Oct 23 23:10:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26636613630636539', 'path': '/dev/sde'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636613630636539', 'path': '/dev/sde'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:10:31 user nova-compute[74482]: INFO nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Took 5.74 seconds to spawn the instance on the hypervisor.
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lazy-loading 'flavor' on Instance uuid 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:10:31 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:10:31 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:10:31 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:10:31 user nova-compute[74482]:   <serial>cfa348b2-75f3-40a2-81f9-c03e90ca153c</serial>
Oct 23 23:10:31 user nova-compute[74482]: </disk>
Oct 23 23:10:31 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:10:31 user nova-compute[74482]: INFO nova.compute.manager [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Took 6.70 seconds to build instance.
Oct 23 23:10:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eebbde2a-1e89-48a5-a3b6-6eeabad4bb28 tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.807s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] No VIF found with MAC fa:16:3e:99:fd:fe, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:10:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7f8df4ec-4125-4952-bb94-6612b6219f81 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.366s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lazy-loading 'flavor' on Instance uuid 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:37 user nova-compute[74482]: INFO nova.compute.manager [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Attaching volume 52b3d9be-832d-429f-98e0-5b5711698f22 to /dev/vdc
Oct 23 23:10:37 user nova-compute[74482]: DEBUG os_brick.utils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e982d7-b634-4304-ad06-54a4de1b58c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5cc22a-ae7b-4950-9f73-8378b255a79a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ed74d-4b80-47b4-9434-e964c59c014a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6542d791-b2ce-4fe0-b39c-0be5f5902f07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:10:38 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:10:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263b890-f2ef-4750-8054-a6d14d3a761d]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG os_brick.utils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Updating existing volume attachment record: 4bf406cd-37f3-406c-a672-69d87cc18c7d {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:10:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "095c2860-554f-4622-902d-8cafda6dbfe9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:10:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:45 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:10:45 user nova-compute[74482]: INFO nova.compute.claims [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Claim successful on node user
Oct 23 23:10:46 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:10:46 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:10:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:10:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:10:46 user nova-compute[74482]: DEBUG nova.network.neutron [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:10:46 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:10:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:10:46 user nova-compute[74482]: INFO nova.virt.block_device [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Booting with volume-backed-image 8269c4ae-64d4-478e-8976-b601953bda88 at /dev/vda
Oct 23 23:10:46 user nova-compute[74482]: DEBUG nova.policy [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebd17d342e7145e0bad04188ec8be780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '981f084ec65e4fa0a9cbd2e5edf8302a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:10:47 user nova-compute[74482]: DEBUG nova.network.neutron [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Successfully created port: 9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:10:47 user nova-compute[74482]: DEBUG nova.network.neutron [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Successfully updated port: 9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquired lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-182d9c9d-2210-43b8-8d09-173d7c8b7312 req-8eac4be5-6ef6-4354-82ce-476a470887e9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-changed-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-182d9c9d-2210-43b8-8d09-173d7c8b7312 req-8eac4be5-6ef6-4354-82ce-476a470887e9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Refreshing instance network info cache due to event network-changed-9f475537-5a5a-4a04-acf9-d114075b47c2. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-182d9c9d-2210-43b8-8d09-173d7c8b7312 req-8eac4be5-6ef6-4354-82ce-476a470887e9 service nova] Acquiring lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Updating instance_info_cache with network_info: [{"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Releasing lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Instance network_info: |[{"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-182d9c9d-2210-43b8-8d09-173d7c8b7312 req-8eac4be5-6ef6-4354-82ce-476a470887e9 service nova] Acquired lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-182d9c9d-2210-43b8-8d09-173d7c8b7312 req-8eac4be5-6ef6-4354-82ce-476a470887e9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Refreshing network info cache for port 9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-182d9c9d-2210-43b8-8d09-173d7c8b7312 req-8eac4be5-6ef6-4354-82ce-476a470887e9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Updated VIF entry in instance network info cache for port 9f475537-5a5a-4a04-acf9-d114075b47c2. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-182d9c9d-2210-43b8-8d09-173d7c8b7312 req-8eac4be5-6ef6-4354-82ce-476a470887e9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Updating instance_info_cache with network_info: [{"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-182d9c9d-2210-43b8-8d09-173d7c8b7312 req-8eac4be5-6ef6-4354-82ce-476a470887e9 service nova] Releasing lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:10:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:50 user nova-compute[74482]: INFO nova.compute.manager [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Detaching volume 9a907fac-6bfc-418a-9a11-c56983d1ae76
Oct 23 23:10:50 user nova-compute[74482]: INFO nova.virt.block_device [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Attempting to driver detach volume 9a907fac-6bfc-418a-9a11-c56983d1ae76 from mountpoint /dev/vdb
Oct 23 23:10:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Attempting to detach device vdb from instance bbedc3ec-0f54-4977-8546-41ce4f488641 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:10:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:10:50 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:10:50 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:10:50 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:10:50 user nova-compute[74482]:   <serial>9a907fac-6bfc-418a-9a11-c56983d1ae76</serial>
Oct 23 23:10:50 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 23:10:50 user nova-compute[74482]: </disk>
Oct 23 23:10:50 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:10:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully detached device vdb from instance bbedc3ec-0f54-4977-8546-41ce4f488641 from the persistent domain config.
Oct 23 23:10:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bbedc3ec-0f54-4977-8546-41ce4f488641 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:10:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:10:50 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:10:50 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:10:50 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:10:50 user nova-compute[74482]:   <serial>9a907fac-6bfc-418a-9a11-c56983d1ae76</serial>
Oct 23 23:10:50 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 23:10:50 user nova-compute[74482]: </disk>
Oct 23 23:10:50 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:10:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:10:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXgQcqLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:10:56 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:10:56 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:10:56 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[030ecc18-10f3-426e-9919-026811295047]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:10:56 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f29da22-3a6f-4c3f-98df-91f59ac1b7ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22] added
Oct 23 23:10:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49c308-0d34-4e10-9ef6-66cd04020724]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fd9888-8d13-494b-b6e3-00af405b1561]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXgQcqLn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXgQcqLn" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d1d3ff-684c-465c-81c4-baa7042f3d2c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AXgQcqLn'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e5476-1c3b-482a-b286-f6ef14dcbfc4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad3703c-7ea9-4b11-bc1f-a1a5c776f7dd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:56 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:56 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:10:56 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:56 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:56 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:10:56 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1474ac86-b241-44e7-8f59-8d2f7888020a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22, portal: 172.16.0.220,3260]
Oct 23 23:10:56 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22, portal: 172.16.0.220,3260] successful.
Oct 23 23:10:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[774a99f8-81be-4b94-a3eb-bebedbcfb97b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b2a93a-6675-47ee-9c1c-195f0a3aa34d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:57 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:57 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:10:57 user nova-compute[74482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 (non-flash)
Oct 23 23:10:57 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:10:57 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:10:57 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:10:57 user nova-compute[74482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 (non-flash)
Oct 23 23:10:57 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:10:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4819a3-d561-4629-a34d-067b52e302fb]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:10:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXgQcqLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23864653062663136', 'path': '/dev/sdf'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864653062663136', 'path': '/dev/sdf'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lazy-loading 'flavor' on Instance uuid 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:10:58 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:10:58 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:10:58 user nova-compute[74482]:   <target dev="vdc" bus="virtio"/>
Oct 23 23:10:58 user nova-compute[74482]:   <serial>52b3d9be-832d-429f-98e0-5b5711698f22</serial>
Oct 23 23:10:58 user nova-compute[74482]: </disk>
Oct 23 23:10:58 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] No VIF found with MAC fa:16:3e:99:fd:fe, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:10:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4f0fce8c-f520-49e1-b148-25c022c7f16c tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.839s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:10:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:10:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:10:59 user nova-compute[74482]: INFO nova.compute.manager [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Detaching volume 52b3d9be-832d-429f-98e0-5b5711698f22
Oct 23 23:10:59 user nova-compute[74482]: INFO nova.virt.block_device [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Attempting to driver detach volume 52b3d9be-832d-429f-98e0-5b5711698f22 from mountpoint /dev/vdc
Oct 23 23:10:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Attempting to detach device vdc from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:10:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:10:59 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:10:59 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:10:59 user nova-compute[74482]:   <target dev="vdc" bus="virtio"/>
Oct 23 23:10:59 user nova-compute[74482]:   <serial>52b3d9be-832d-429f-98e0-5b5711698f22</serial>
Oct 23 23:10:59 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 23:10:59 user nova-compute[74482]: </disk>
Oct 23 23:10:59 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:10:59 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Successfully detached device vdc from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 from the persistent domain config.
Oct 23 23:10:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:10:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:10:59 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:10:59 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:10:59 user nova-compute[74482]:   <target dev="vdc" bus="virtio"/>
Oct 23 23:10:59 user nova-compute[74482]:   <serial>52b3d9be-832d-429f-98e0-5b5711698f22</serial>
Oct 23 23:10:59 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 23:10:59 user nova-compute[74482]: </disk>
Oct 23 23:10:59 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:10:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG os_brick.utils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce24bb1-b3ce-4d22-b501-aec0e3138445]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac4a8d-88cd-47ab-9320-e849ba88ccd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ece49d-fbb0-4a0b-8d6e-19d2f0352636]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd3b791-ca98-46aa-9391-587e53119b35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:11:02 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:11:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[09697ddf-8021-43d7-a667-0d2cd297516e]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG os_brick.utils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:11:02 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Updating existing volume attachment record: b3164928-165d-4f4d-b579-ded300eb02cb {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:11:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:10 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bbedc3ec-0f54-4977-8546-41ce4f488641 is timed out.
Oct 23 23:11:10 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully detached device vdb from instance bbedc3ec-0f54-4977-8546-41ce4f488641 from the live domain config.
Oct 23 23:11:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVskdhMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:11:10 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea03594-f4b7-4cb4-9c5a-d781204c4500]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:11:10 user nova-compute[74482]: No targets found.
Oct 23 23:11:10 user nova-compute[74482]: iSNS:
Oct 23 23:11:10 user nova-compute[74482]: No targets found.
Oct 23 23:11:10 user nova-compute[74482]: STATIC:
Oct 23 23:11:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a
Oct 23 23:11:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:11:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:11:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c
Oct 23 23:11:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:11:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:11:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22
Oct 23 23:11:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:11:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:11:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76
Oct 23 23:11:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:11:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:11:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:11:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:11:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:11:10 user nova-compute[74482]: FIRMWARE:
Oct 23 23:11:10 user nova-compute[74482]: No targets found.
Oct 23 23:11:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:11:10 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:11:10 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1d8f93-aa0f-4091-b240-45d0935aced5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad86289-3a16-44c2-affa-43c18545c9c7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:11:10 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:10 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:10 user nova-compute[74482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 (non-flash)
Oct 23 23:11:10 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 (non-flash)
Oct 23 23:11:10 user nova-compute[74482]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:10 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:10 user nova-compute[74482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 (non-flash)
Oct 23 23:11:10 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c493490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ed54db-0b96-4daa-8253-09c271922b39]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd099a83-d077-44b5-a57c-dd96617847fb]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[788e11f5-7240-4f2d-9aed-e6269fee5f7d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f4de49-c218-4d20-8595-c1cddd88471f]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3868a63d-d0d7-4ba8-bcc6-3f9e0e85170b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[538116bd-21d8-4e20-8bcf-2b9ff27bfd80]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260]
Oct 23 23:11:11 user nova-compute[74482]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76, portal: 172.16.0.220,3260] successful.
Oct 23 23:11:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a907fac-6bfc-418a-9a11-c56983d1ae76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1702f81-afd7-4e56-8f74-820be328428a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== disconnect_volume: return (353ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:11:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:11:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:11:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:11:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:11:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:11:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:11:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ec66b7ce-0e6b-4255-b256-1126421a9a7b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.823s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG nova.objects.instance [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'flavor' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:15 user nova-compute[74482]: INFO nova.compute.manager [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Attaching volume 99cdd5d3-493b-47e7-a698-83647110de25 to /dev/vdb
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG os_brick.utils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd045d-0e40-4a21-b5b6-4d5af3f96f6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3471b2c-ce88-4e9d-ae29-5fd6d484822b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6199a7ce-b351-4a8b-a4d2-a352e24929b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ce8f32-a0a4-4847-b205-75783eae7626]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:11:15 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30e2df5-12c0-4210-8574-469471316a80]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG os_brick.utils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updating existing volume attachment record: 62fe85b4-1982-4d9a-a666-229c98f0a973 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f76df9ec-faac-4c45-8a74-b66697eab43e tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f76df9ec-faac-4c45-8a74-b66697eab43e tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f76df9ec-faac-4c45-8a74-b66697eab43e tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f76df9ec-faac-4c45-8a74-b66697eab43e tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74482) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 23 23:11:15 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f76df9ec-faac-4c45-8a74-b66697eab43e tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-8c1eae71-e9b1-425d-81c7-486d09d13a65 req-e8a85493-7d6c-4257-afb8-b67bf56ac4cc service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-unplugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8c1eae71-e9b1-425d-81c7-486d09d13a65 req-e8a85493-7d6c-4257-afb8-b67bf56ac4cc service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8c1eae71-e9b1-425d-81c7-486d09d13a65 req-e8a85493-7d6c-4257-afb8-b67bf56ac4cc service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8c1eae71-e9b1-425d-81c7-486d09d13a65 req-e8a85493-7d6c-4257-afb8-b67bf56ac4cc service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-8c1eae71-e9b1-425d-81c7-486d09d13a65 req-e8a85493-7d6c-4257-afb8-b67bf56ac4cc service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-unplugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:11:16 user nova-compute[74482]: WARNING nova.compute.manager [req-8c1eae71-e9b1-425d-81c7-486d09d13a65 req-e8a85493-7d6c-4257-afb8-b67bf56ac4cc service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-unplugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state active and task_state powering-off.
Oct 23 23:11:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updating instance_info_cache with network_info: [{"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance destroyed successfully.
Oct 23 23:11:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f76df9ec-faac-4c45-8a74-b66697eab43e tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:11:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f76df9ec-faac-4c45-8a74-b66697eab43e tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.951s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:17 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:11:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-3cf9e2a7-893c-4fe8-b0fc-0f80e87a852b req-0064fb87-89d2-41a8-ae0d-0d1660e6c283 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3cf9e2a7-893c-4fe8-b0fc-0f80e87a852b req-0064fb87-89d2-41a8-ae0d-0d1660e6c283 service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3cf9e2a7-893c-4fe8-b0fc-0f80e87a852b req-0064fb87-89d2-41a8-ae0d-0d1660e6c283 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3cf9e2a7-893c-4fe8-b0fc-0f80e87a852b req-0064fb87-89d2-41a8-ae0d-0d1660e6c283 service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-3cf9e2a7-893c-4fe8-b0fc-0f80e87a852b req-0064fb87-89d2-41a8-ae0d-0d1660e6c283 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:11:18 user nova-compute[74482]: WARNING nova.compute.manager [req-3cf9e2a7-893c-4fe8-b0fc-0f80e87a852b req-0064fb87-89d2-41a8-ae0d-0d1660e6c283 service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state stopped and task_state None.
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 is timed out.
Oct 23 23:11:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Successfully detached device vdc from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 from the live domain config.
Oct 23 23:11:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXgQcqLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:11:19 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:11:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:11:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e661b4a2-fc0e-412d-9401-b9bab9e1003f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:11:20 user nova-compute[74482]: No targets found.
Oct 23 23:11:20 user nova-compute[74482]: iSNS:
Oct 23 23:11:20 user nova-compute[74482]: No targets found.
Oct 23 23:11:20 user nova-compute[74482]: STATIC:
Oct 23 23:11:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a
Oct 23 23:11:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:11:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:11:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c
Oct 23 23:11:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:11:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:11:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22
Oct 23 23:11:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:11:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:11:20 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:11:20 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:11:20 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:11:20 user nova-compute[74482]: FIRMWARE:
Oct 23 23:11:20 user nova-compute[74482]: No targets found.
Oct 23 23:11:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:11:20 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:11:20 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7b596c-2125-4d9c-9ac5-32fd6fb1c380]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e280213-23f4-4e02-ac0f-ea6ead47339f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:20 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:20 user nova-compute[74482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 (non-flash)
Oct 23 23:11:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:20 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:20 user nova-compute[74482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 (non-flash)
Oct 23 23:11:20 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c490160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22'): ({'sdf'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Removing single pathed devices sdf {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f66287-f0f8-4a98-9a1d-bc06eafe382a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[192b48bf-f0da-4a20-abea-ad631dcf1440]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Flushing IO for device /dev/sdf {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d7ada2-fa71-4bb9-b58e-cf2eaf6264f7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c021fd7-6593-4701-a48b-74b651d15818]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b831b-b3e8-4e37-a904-c5547eaa388d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[807d656e-c7f0-448a-833f-c60d7f252c99]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22, portal: 172.16.0.220,3260]
Oct 23 23:11:20 user nova-compute[74482]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22, portal: 172.16.0.220,3260] successful.
Oct 23 23:11:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b3d9be-832d-429f-98e0-5b5711698f22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[df83e161-1c3d-4b28-a078-1e0a1d8dd75b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] <== disconnect_volume: return (374ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lazy-loading 'flavor' on Instance uuid 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-10a612a7-390c-4f2f-ab37-bb512a2a4ebd tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.945s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:11:21 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Creating image(s)
Oct 23 23:11:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Ensure instance console log exists: /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Start _get_guest_xml network_info=[{"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkpgPTXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '095c2860-554f-4622-902d-8cafda6dbfe9', 'attached_at': '', 'detached_at': '', 'volume_id': '55f404ac-63d4-4371-98ad-8de4f7c82d18', 'serial': '55f404ac-63d4-4371-98ad-8de4f7c82d18'}, 'disk_bus': 'virtio', 'attachment_id': 'b3164928-165d-4f4d-b579-ded300eb02cb', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:11:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:11:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkpgPTXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:11:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:11:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:11:22 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b2ee57-f29d-4a80-9ded-131f1803873d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:11:22 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff8992a-8f22-4c5c-9349-013116950358]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18] added
Oct 23 23:11:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3a652b-1f30-4d61-a939-9e23e7ede8ca]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cd5e49-3227-41e2-bcc5-e107acf2c337]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkpgPTXI {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkpgPTXI" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b991d2-d207-44e4-b0e1-bf0710cb3577]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkpgPTXI'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bd0da9-ae5a-476d-abaa-5384d485ffea]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1729e70-bfd7-40bf-bd6d-1a7e4712c9d4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d984239-2be2-42e7-9b97-f5c82e2638dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18, portal: 172.16.0.220,3260]
Oct 23 23:11:22 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18, portal: 172.16.0.220,3260] successful.
Oct 23 23:11:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b896714-2853-44b6-9005-265f2fbc8d7a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[be91307b-fe0f-4a3f-9dbe-16932dae3c40]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:11:22 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99191490-a4a4-4aa9-93aa-d621249bc3dc]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkpgPTXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.548s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] <== connect_volume: return (1550ms) {'type': 'block', 'scsi_wwn': '23632623064343039', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632623064343039', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:11:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:11:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7355MB free_disk=24.887542724609375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1298325207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1298325207',id=24,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-3l14jumo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:10:47Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=095c2860-554f-4622-902d-8cafda6dbfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f475537-5a5a-4a04-acf9-d114075b47c2,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f475537-5a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.objects.instance [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'pci_devices' on Instance uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:11:23 user nova-compute[74482]:   <uuid>095c2860-554f-4622-902d-8cafda6dbfe9</uuid>
Oct 23 23:11:23 user nova-compute[74482]:   <name>instance-00000018</name>
Oct 23 23:11:23 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:11:23 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:11:23 user nova-compute[74482]:   <metadata>
Oct 23 23:11:23 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:11:23 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:11:23 user nova-compute[74482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1298325207</nova:name>
Oct 23 23:11:23 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:11:22</nova:creationTime>
Oct 23 23:11:23 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:11:23 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:11:23 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:11:23 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:11:23 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:11:23 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:11:23 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:11:23 user nova-compute[74482]:       <nova:owner>
Oct 23 23:11:23 user nova-compute[74482]:         <nova:user uuid="ebd17d342e7145e0bad04188ec8be780">tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member</nova:user>
Oct 23 23:11:23 user nova-compute[74482]:         <nova:project uuid="981f084ec65e4fa0a9cbd2e5edf8302a">tempest-ServerBootFromVolumeStableRescueTest-157113739</nova:project>
Oct 23 23:11:23 user nova-compute[74482]:       </nova:owner>
Oct 23 23:11:23 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:11:23 user nova-compute[74482]:       <nova:ports>
Oct 23 23:11:23 user nova-compute[74482]:         <nova:port uuid="9f475537-5a5a-4a04-acf9-d114075b47c2">
Oct 23 23:11:23 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 23:11:23 user nova-compute[74482]:         </nova:port>
Oct 23 23:11:23 user nova-compute[74482]:       </nova:ports>
Oct 23 23:11:23 user nova-compute[74482]:     </nova:instance>
Oct 23 23:11:23 user nova-compute[74482]:   </metadata>
Oct 23 23:11:23 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:11:23 user nova-compute[74482]:     <system>
Oct 23 23:11:23 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:11:23 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:11:23 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:11:23 user nova-compute[74482]:       <entry name="serial">095c2860-554f-4622-902d-8cafda6dbfe9</entry>
Oct 23 23:11:23 user nova-compute[74482]:       <entry name="uuid">095c2860-554f-4622-902d-8cafda6dbfe9</entry>
Oct 23 23:11:23 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:11:23 user nova-compute[74482]:     </system>
Oct 23 23:11:23 user nova-compute[74482]:   </sysinfo>
Oct 23 23:11:23 user nova-compute[74482]:   <os>
Oct 23 23:11:23 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:11:23 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:11:23 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:11:23 user nova-compute[74482]:   </os>
Oct 23 23:11:23 user nova-compute[74482]:   <features>
Oct 23 23:11:23 user nova-compute[74482]:     <acpi/>
Oct 23 23:11:23 user nova-compute[74482]:     <apic/>
Oct 23 23:11:23 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:11:23 user nova-compute[74482]:   </features>
Oct 23 23:11:23 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:11:23 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:11:23 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:11:23 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:11:23 user nova-compute[74482]:   </clock>
Oct 23 23:11:23 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:11:23 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:11:23 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:11:23 user nova-compute[74482]:   </cpu>
Oct 23 23:11:23 user nova-compute[74482]:   <devices>
Oct 23 23:11:23 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:11:23 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:11:23 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:11:23 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:11:23 user nova-compute[74482]:       <serial>55f404ac-63d4-4371-98ad-8de4f7c82d18</serial>
Oct 23 23:11:23 user nova-compute[74482]:     </disk>
Oct 23 23:11:23 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:11:23 user nova-compute[74482]:       <mac address="fa:16:3e:2e:f4:4b"/>
Oct 23 23:11:23 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:11:23 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:11:23 user nova-compute[74482]:       <target dev="tap9f475537-5a"/>
Oct 23 23:11:23 user nova-compute[74482]:     </interface>
Oct 23 23:11:23 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:11:23 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/console.log" append="off"/>
Oct 23 23:11:23 user nova-compute[74482]:     </serial>
Oct 23 23:11:23 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:11:23 user nova-compute[74482]:     <video>
Oct 23 23:11:23 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:11:23 user nova-compute[74482]:     </video>
Oct 23 23:11:23 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:11:23 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:11:23 user nova-compute[74482]:     </rng>
Oct 23 23:11:23 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:11:23 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:11:23 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:11:23 user nova-compute[74482]:     </memballoon>
Oct 23 23:11:23 user nova-compute[74482]:   </devices>
Oct 23 23:11:23 user nova-compute[74482]: </domain>
Oct 23 23:11:23 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1298325207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1298325207',id=24,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-3l14jumo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:10:47Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=095c2860-554f-4622-902d-8cafda6dbfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f475537-5a5a-4a04-acf9-d114075b47c2,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f475537-5a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG os_vif [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f475537-5a5a-4a04-acf9-d114075b47c2,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f475537-5a') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a30493a-0fb9-502e-bfa9-025a19235243', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f475537-5a, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f475537-5a, col_values=(('qos', UUID('52d803cb-b113-4b56-b955-8b291c13926d')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f475537-5a, col_values=(('external_ids', {'iface-id': '9f475537-5a5a-4a04-acf9-d114075b47c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:f4:4b', 'vm-uuid': '095c2860-554f-4622-902d-8cafda6dbfe9'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:23 user nova-compute[74482]: INFO os_vif [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f475537-5a5a-4a04-acf9-d114075b47c2,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f475537-5a')
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 1718ea62-105b-44ac-80f6-587224314449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance a18c958b-f7d9-47ba-ad98-332e12838d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 599b9f36-af3c-405a-ae1d-088325a1fa03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 100db750-f1d1-4823-89e3-0e1089266725 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 233cb56f-9cce-4c10-94db-cf694a20af1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance ca2ec70c-36af-46dd-ae94-2abdd17df8ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 095c2860-554f-4622-902d-8cafda6dbfe9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:11:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No VIF found with MAC fa:16:3e:2e:f4:4b, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "100db750-f1d1-4823-89e3-0e1089266725" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "100db750-f1d1-4823-89e3-0e1089266725" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "100db750-f1d1-4823-89e3-0e1089266725-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:24 user nova-compute[74482]: INFO nova.compute.manager [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Terminating instance
Oct 23 23:11:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-789c31b9-6956-48d7-8a62-070e59960d57 req-2b5efced-5178-47bb-a6cb-a7ce58298433 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received event network-vif-unplugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-789c31b9-6956-48d7-8a62-070e59960d57 req-2b5efced-5178-47bb-a6cb-a7ce58298433 service nova] Acquiring lock "100db750-f1d1-4823-89e3-0e1089266725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-789c31b9-6956-48d7-8a62-070e59960d57 req-2b5efced-5178-47bb-a6cb-a7ce58298433 service nova] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-789c31b9-6956-48d7-8a62-070e59960d57 req-2b5efced-5178-47bb-a6cb-a7ce58298433 service nova] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-789c31b9-6956-48d7-8a62-070e59960d57 req-2b5efced-5178-47bb-a6cb-a7ce58298433 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] No waiting events found dispatching network-vif-unplugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-789c31b9-6956-48d7-8a62-070e59960d57 req-2b5efced-5178-47bb-a6cb-a7ce58298433 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received event network-vif-unplugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:25 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Instance destroyed successfully.
Oct 23 23:11:25 user nova-compute[74482]: DEBUG nova.objects.instance [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lazy-loading 'resources' on Instance uuid 100db750-f1d1-4823-89e3-0e1089266725 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1137023492',display_name='tempest-VolumesAdminNegativeTest-server-1137023492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1137023492',id=21,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98b95877b43e4d458fd124f0ae506aaf',ramdisk_id='',reservation_id='r-mz62ec6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1781155714',owner_user_name='tempest-VolumesAdminNegativeTest-1781155714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:09:29Z,user_data=None,user_id='4f2f6cc277224a04a377fc0bfc3b5021',uuid=100db750-f1d1-4823-89e3-0e1089266725,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "address": "fa:16:3e:07:f7:09", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14caf373-8f", "ovs_interfaceid": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converting VIF {"id": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "address": "fa:16:3e:07:f7:09", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14caf373-8f", "ovs_interfaceid": "14caf373-8f4a-4b82-80a1-3d55c61cdb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f7:09,bridge_name='br-int',has_traffic_filtering=True,id=14caf373-8f4a-4b82-80a1-3d55c61cdb6d,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14caf373-8f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG os_vif [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f7:09,bridge_name='br-int',has_traffic_filtering=True,id=14caf373-8f4a-4b82-80a1-3d55c61cdb6d,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14caf373-8f') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14caf373-8f, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea803b91-3f73-4138-8123-2856baebe0eb) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:25 user nova-compute[74482]: INFO os_vif [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f7:09,bridge_name='br-int',has_traffic_filtering=True,id=14caf373-8f4a-4b82-80a1-3d55c61cdb6d,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14caf373-8f')
Oct 23 23:11:25 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Deleting instance files /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725_del
Oct 23 23:11:25 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Deletion of /opt/stack/data/nova/instances/100db750-f1d1-4823-89e3-0e1089266725_del complete
Oct 23 23:11:25 user nova-compute[74482]: INFO nova.compute.manager [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 23 23:11:25 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 100db750-f1d1-4823-89e3-0e1089266725] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-50f4517d-5c2f-4056-933e-3db344b90d3f req-b59d5c4f-6fa2-4157-8a5a-16a44dd06232 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-50f4517d-5c2f-4056-933e-3db344b90d3f req-b59d5c4f-6fa2-4157-8a5a-16a44dd06232 service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-50f4517d-5c2f-4056-933e-3db344b90d3f req-b59d5c4f-6fa2-4157-8a5a-16a44dd06232 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-50f4517d-5c2f-4056-933e-3db344b90d3f req-b59d5c4f-6fa2-4157-8a5a-16a44dd06232 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-50f4517d-5c2f-4056-933e-3db344b90d3f req-b59d5c4f-6fa2-4157-8a5a-16a44dd06232 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:11:25 user nova-compute[74482]: WARNING nova.compute.manager [req-50f4517d-5c2f-4056-933e-3db344b90d3f req-b59d5c4f-6fa2-4157-8a5a-16a44dd06232 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state building and task_state spawning.
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:26 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:11:26 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Took 0.82 seconds to deallocate network for instance.
Oct 23 23:11:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-244c64fc-abe9-4650-a0f5-08d25b507707 req-8f302d69-b3fe-4682-bb1f-9514df225da9 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received event network-vif-plugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:11:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-244c64fc-abe9-4650-a0f5-08d25b507707 req-8f302d69-b3fe-4682-bb1f-9514df225da9 service nova] Acquiring lock "100db750-f1d1-4823-89e3-0e1089266725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-244c64fc-abe9-4650-a0f5-08d25b507707 req-8f302d69-b3fe-4682-bb1f-9514df225da9 service nova] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-244c64fc-abe9-4650-a0f5-08d25b507707 req-8f302d69-b3fe-4682-bb1f-9514df225da9 service nova] Lock "100db750-f1d1-4823-89e3-0e1089266725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-244c64fc-abe9-4650-a0f5-08d25b507707 req-8f302d69-b3fe-4682-bb1f-9514df225da9 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] No waiting events found dispatching network-vif-plugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:11:26 user nova-compute[74482]: WARNING nova.compute.manager [req-244c64fc-abe9-4650-a0f5-08d25b507707 req-8f302d69-b3fe-4682-bb1f-9514df225da9 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received unexpected event network-vif-plugged-14caf373-8f4a-4b82-80a1-3d55c61cdb6d for instance with vm_state deleted and task_state None.
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:27 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Deleted allocations for instance 100db750-f1d1-4823-89e3-0e1089266725
Oct 23 23:11:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-caebd3f1-8053-4e98-b54d-20981dd37e03 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "100db750-f1d1-4823-89e3-0e1089266725" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.665s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:11:27 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Instance spawned successfully.
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-e6736efc-dc12-435f-a2a7-f708a0845a19 req-3fbb5b76-5a5b-45be-9a2e-feedb8605694 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e6736efc-dc12-435f-a2a7-f708a0845a19 req-3fbb5b76-5a5b-45be-9a2e-feedb8605694 service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e6736efc-dc12-435f-a2a7-f708a0845a19 req-3fbb5b76-5a5b-45be-9a2e-feedb8605694 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e6736efc-dc12-435f-a2a7-f708a0845a19 req-3fbb5b76-5a5b-45be-9a2e-feedb8605694 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-e6736efc-dc12-435f-a2a7-f708a0845a19 req-3fbb5b76-5a5b-45be-9a2e-feedb8605694 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:11:27 user nova-compute[74482]: WARNING nova.compute.manager [req-e6736efc-dc12-435f-a2a7-f708a0845a19 req-3fbb5b76-5a5b-45be-9a2e-feedb8605694 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state building and task_state spawning.
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-e6736efc-dc12-435f-a2a7-f708a0845a19 req-3fbb5b76-5a5b-45be-9a2e-feedb8605694 service nova] [instance: 100db750-f1d1-4823-89e3-0e1089266725] Received event network-vif-deleted-14caf373-8f4a-4b82-80a1-3d55c61cdb6d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:11:27 user nova-compute[74482]: INFO nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Took 5.98 seconds to spawn the instance on the hypervisor.
Oct 23 23:11:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:11:28 user nova-compute[74482]: INFO nova.compute.manager [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Took 42.31 seconds to build instance.
Oct 23 23:11:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-595534cd-ae4d-44d7-881b-6fb1e2cb2861 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "095c2860-554f-4622-902d-8cafda6dbfe9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.426s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:11:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGEpHjuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:11:43 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:11:43 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:11:43 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8135577b-c5cb-40e8-94b3-cc5c41c4b2cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:11:43 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4ee2dd-a9c8-47af-8dce-821123fc40c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25] added
Oct 23 23:11:43 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d5a80c-8f85-41b7-9202-c5c2ea8bf4e7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fb5f03-4ea2-4c87-bd39-3a10863776d1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGEpHjuK {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGEpHjuK" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7902b52-2436-44c1-a5ec-fb94c8961fcf]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UGEpHjuK'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e0daa7-af0d-4979-9848-26c3a581e7a6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad52ace-92b3-4614-8087-f8851129c35a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b4bbad-601c-4237-8643-25c15e58c83b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260]
Oct 23 23:11:43 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260] successful.
Oct 23 23:11:43 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbddf764-22a5-4c78-8064-33746e316459]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a96ef-1331-46f8-9649-3afb63575d38]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:11:43 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[51427191-fc2a-475b-a053-999dc3561d34]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:11:43 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:11:44 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:11:44 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGEpHjuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:11:44 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:11:44 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23036333164323764', 'path': '/dev/sdf'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:11:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036333164323764', 'path': '/dev/sdf'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:11:44 user nova-compute[74482]: DEBUG nova.objects.instance [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'flavor' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:11:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:11:44 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:11:44 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:11:44 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:11:44 user nova-compute[74482]:   <serial>99cdd5d3-493b-47e7-a698-83647110de25</serial>
Oct 23 23:11:44 user nova-compute[74482]: </disk>
Oct 23 23:11:44 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:11:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:11:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:11:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No VIF found with MAC fa:16:3e:ca:2a:fe, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:11:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8e8dbd52-0e50-454b-9a9b-e16866d4ed55 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.493s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:11:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:50 user nova-compute[74482]: INFO nova.compute.manager [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Detaching volume cfa348b2-75f3-40a2-81f9-c03e90ca153c
Oct 23 23:11:50 user nova-compute[74482]: INFO nova.virt.block_device [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Attempting to driver detach volume cfa348b2-75f3-40a2-81f9-c03e90ca153c from mountpoint /dev/vdb
Oct 23 23:11:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Attempting to detach device vdb from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:11:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:11:50 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:11:50 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:11:50 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:11:50 user nova-compute[74482]:   <serial>cfa348b2-75f3-40a2-81f9-c03e90ca153c</serial>
Oct 23 23:11:50 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:11:50 user nova-compute[74482]: </disk>
Oct 23 23:11:50 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:11:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Successfully detached device vdb from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 from the persistent domain config.
Oct 23 23:11:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:11:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:11:50 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:11:50 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:11:50 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:11:50 user nova-compute[74482]:   <serial>cfa348b2-75f3-40a2-81f9-c03e90ca153c</serial>
Oct 23 23:11:50 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:11:50 user nova-compute[74482]: </disk>
Oct 23 23:11:50 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:11:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:11:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-abaf052a-4b79-4664-a9dc-c114d06f2343 req-e612ee0a-984f-4d35-b3d7-1e9ab200438d service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:11:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-abaf052a-4b79-4664-a9dc-c114d06f2343 req-e612ee0a-984f-4d35-b3d7-1e9ab200438d service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing instance network info cache due to event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:11:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-abaf052a-4b79-4664-a9dc-c114d06f2343 req-e612ee0a-984f-4d35-b3d7-1e9ab200438d service nova] Acquiring lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:11:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-abaf052a-4b79-4664-a9dc-c114d06f2343 req-e612ee0a-984f-4d35-b3d7-1e9ab200438d service nova] Acquired lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:11:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-abaf052a-4b79-4664-a9dc-c114d06f2343 req-e612ee0a-984f-4d35-b3d7-1e9ab200438d service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:11:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-abaf052a-4b79-4664-a9dc-c114d06f2343 req-e612ee0a-984f-4d35-b3d7-1e9ab200438d service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updated VIF entry in instance network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:11:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-abaf052a-4b79-4664-a9dc-c114d06f2343 req-e612ee0a-984f-4d35-b3d7-1e9ab200438d service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updating instance_info_cache with network_info: [{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:11:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-abaf052a-4b79-4664-a9dc-c114d06f2343 req-e612ee0a-984f-4d35-b3d7-1e9ab200438d service nova] Releasing lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:11:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:11:59 user nova-compute[74482]: INFO nova.compute.claims [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Claim successful on node user
Oct 23 23:11:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-02a3cf8e-c397-47cb-8d1b-adde8e4ddcf3 req-39eab54f-56b4-4307-ae77-9093faa935f3 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-02a3cf8e-c397-47cb-8d1b-adde8e4ddcf3 req-39eab54f-56b4-4307-ae77-9093faa935f3 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing instance network info cache due to event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-02a3cf8e-c397-47cb-8d1b-adde8e4ddcf3 req-39eab54f-56b4-4307-ae77-9093faa935f3 service nova] Acquiring lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-02a3cf8e-c397-47cb-8d1b-adde8e4ddcf3 req-39eab54f-56b4-4307-ae77-9093faa935f3 service nova] Acquired lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:11:59 user nova-compute[74482]: DEBUG nova.network.neutron [req-02a3cf8e-c397-47cb-8d1b-adde8e4ddcf3 req-39eab54f-56b4-4307-ae77-9093faa935f3 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.network.neutron [req-02a3cf8e-c397-47cb-8d1b-adde8e4ddcf3 req-39eab54f-56b4-4307-ae77-9093faa935f3 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updated VIF entry in instance network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.network.neutron [req-02a3cf8e-c397-47cb-8d1b-adde8e4ddcf3 req-39eab54f-56b4-4307-ae77-9093faa935f3 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updating instance_info_cache with network_info: [{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-02a3cf8e-c397-47cb-8d1b-adde8e4ddcf3 req-39eab54f-56b4-4307-ae77-9093faa935f3 service nova] Releasing lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:12:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:12:00 user nova-compute[74482]: INFO nova.virt.block_device [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Booting with volume bc22b3b7-f89b-4f40-9210-727055244fbe at /dev/vda
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.policy [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6e62933fe47479baf3029e44d3b8759', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7418b41ef984478daf12ce3a2c72c3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG os_brick.utils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[de964c8e-ec61-46b1-9b4c-24ac5a7783c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14552bc-4137-40f0-a825-6dff7504c9ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce6c67b-b4e6-4c3e-b903-d6a6b87ffd4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e17905-abde-499a-8b87-682eae3411f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:12:00 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:12:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5ead5d-b39e-47f4-b8ef-2dfb756077c0]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG os_brick.utils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating existing volume attachment record: 121bff9e-bafe-4e3f-8862-7e0cdfb4ecbd {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:12:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Successfully created port: ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:12:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Successfully updated port: ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:12:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:12:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquired lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:12:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:12:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-d3b0456d-c966-492d-881a-741fb60f6811 req-79cd3e62-1196-4049-89c9-42b5fe7d297f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-changed-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-d3b0456d-c966-492d-881a-741fb60f6811 req-79cd3e62-1196-4049-89c9-42b5fe7d297f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Refreshing instance network info cache due to event network-changed-ff82f9a6-5f42-4e98-b4df-93bbfb502665. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:12:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d3b0456d-c966-492d-881a-741fb60f6811 req-79cd3e62-1196-4049-89c9-42b5fe7d297f service nova] Acquiring lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:12:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:12:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating instance_info_cache with network_info: [{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Releasing lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:12:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Instance network_info: |[{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:12:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d3b0456d-c966-492d-881a-741fb60f6811 req-79cd3e62-1196-4049-89c9-42b5fe7d297f service nova] Acquired lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:12:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-d3b0456d-c966-492d-881a-741fb60f6811 req-79cd3e62-1196-4049-89c9-42b5fe7d297f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Refreshing network info cache for port ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:12:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-d3b0456d-c966-492d-881a-741fb60f6811 req-79cd3e62-1196-4049-89c9-42b5fe7d297f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updated VIF entry in instance network info cache for port ff82f9a6-5f42-4e98-b4df-93bbfb502665. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:12:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-d3b0456d-c966-492d-881a-741fb60f6811 req-79cd3e62-1196-4049-89c9-42b5fe7d297f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating instance_info_cache with network_info: [{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d3b0456d-c966-492d-881a-741fb60f6811 req-79cd3e62-1196-4049-89c9-42b5fe7d297f service nova] Releasing lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:12:03 user nova-compute[74482]: INFO nova.compute.manager [None req-d1c8ed65-eccd-47cd-bd6e-c063323ac2f7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Unrescuing
Oct 23 23:12:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d1c8ed65-eccd-47cd-bd6e-c063323ac2f7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:12:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d1c8ed65-eccd-47cd-bd6e-c063323ac2f7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquired lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:12:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d1c8ed65-eccd-47cd-bd6e-c063323ac2f7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:12:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d1c8ed65-eccd-47cd-bd6e-c063323ac2f7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updating instance_info_cache with network_info: [{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d1c8ed65-eccd-47cd-bd6e-c063323ac2f7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Releasing lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:12:03 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d1c8ed65-eccd-47cd-bd6e-c063323ac2f7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'flavor' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-fb3424a3-e5b2-49dc-80f3-77fa9f7c9927 req-2fd60015-c03f-49bd-9210-521abbebb8ac service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-unplugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fb3424a3-e5b2-49dc-80f3-77fa9f7c9927 req-2fd60015-c03f-49bd-9210-521abbebb8ac service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fb3424a3-e5b2-49dc-80f3-77fa9f7c9927 req-2fd60015-c03f-49bd-9210-521abbebb8ac service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fb3424a3-e5b2-49dc-80f3-77fa9f7c9927 req-2fd60015-c03f-49bd-9210-521abbebb8ac service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-fb3424a3-e5b2-49dc-80f3-77fa9f7c9927 req-2fd60015-c03f-49bd-9210-521abbebb8ac service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-unplugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:04 user nova-compute[74482]: WARNING nova.compute.manager [req-fb3424a3-e5b2-49dc-80f3-77fa9f7c9927 req-2fd60015-c03f-49bd-9210-521abbebb8ac service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-unplugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:12:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:04 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Instance destroyed successfully.
Oct 23 23:12:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:06 user nova-compute[74482]: WARNING nova.compute.manager [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:12:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:06 user nova-compute[74482]: WARNING nova.compute.manager [req-29377b25-6fbe-46b0-a4b5-4b63ab390720 req-fa44158e-2066-49ee-bc6c-330bf4df3394 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:12:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-07909612-9d85-405b-8313-5b92f5dcaf61 req-8ef2e69d-5943-4f1b-971f-143570ff885d service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-07909612-9d85-405b-8313-5b92f5dcaf61 req-8ef2e69d-5943-4f1b-971f-143570ff885d service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-07909612-9d85-405b-8313-5b92f5dcaf61 req-8ef2e69d-5943-4f1b-971f-143570ff885d service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-07909612-9d85-405b-8313-5b92f5dcaf61 req-8ef2e69d-5943-4f1b-971f-143570ff885d service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-07909612-9d85-405b-8313-5b92f5dcaf61 req-8ef2e69d-5943-4f1b-971f-143570ff885d service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:08 user nova-compute[74482]: WARNING nova.compute.manager [req-07909612-9d85-405b-8313-5b92f5dcaf61 req-8ef2e69d-5943-4f1b-971f-143570ff885d service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:12:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d1c8ed65-eccd-47cd-bd6e-c063323ac2f7 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:12:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:12:09 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updating instance_info_cache with network_info: [{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:12:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:10 user nova-compute[74482]: INFO nova.compute.manager [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Rebooting instance
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquired lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG nova.network.neutron [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:10 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 is timed out.
Oct 23 23:12:10 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Successfully detached device vdb from instance 599b9f36-af3c-405a-ae1d-088325a1fa03 from the live domain config.
Oct 23 23:12:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWVgsGBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:12:10 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e7a6c9-0878-4329-b42d-38a842495ea4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:12:10 user nova-compute[74482]: No targets found.
Oct 23 23:12:10 user nova-compute[74482]: iSNS:
Oct 23 23:12:10 user nova-compute[74482]: No targets found.
Oct 23 23:12:10 user nova-compute[74482]: STATIC:
Oct 23 23:12:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a
Oct 23 23:12:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:12:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:12:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c
Oct 23 23:12:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:12:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:12:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25
Oct 23 23:12:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:12:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:12:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:12:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:12:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:12:10 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18
Oct 23 23:12:10 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:12:10 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:12:10 user nova-compute[74482]: FIRMWARE:
Oct 23 23:12:10 user nova-compute[74482]: No targets found.
Oct 23 23:12:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:12:10 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:12:10 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0595388f-7de3-4e70-97dd-c3bd3f207713]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG nova.network.neutron [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updating instance_info_cache with network_info: [{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d2248d-507a-4f49-ad42-f1b23d9df57c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:10 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:12:10 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:10 user nova-compute[74482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:10 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:10 user nova-compute[74482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c (non-flash)
Oct 23 23:12:10 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:10 user nova-compute[74482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:10 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30842c1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c'): ({'sde'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Removing single pathed devices sde {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Releasing lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f966f18-58b1-4d88-aead-24089e73c562]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[37120857-85d1-42a0-aa40-b60797287087]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Flushing IO for device /dev/sde {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac94c88e-8964-42e4-80b5-acf99bc7865f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f155a729-7807-4334-9c66-e2bc74e7b9ab]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdbc90a-e1e4-4587-8ee0-27ccc85397bc]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b101b-49d2-415b-95e5-3b9bfccb0b25]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c, portal: 172.16.0.220,3260]
Oct 23 23:12:10 user nova-compute[74482]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c, portal: 172.16.0.220,3260] successful.
Oct 23 23:12:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfa348b2-75f3-40a2-81f9-c03e90ca153c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[248abffa-2bc9-4cc4-8863-c4c1e707adcd]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] <== disconnect_volume: return (350ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:12:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-61b15ef9-a3aa-49c0-9922-56718c8081f1 req-eedd427e-e93a-43c5-8e6d-ee42c96e505b service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-unplugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-61b15ef9-a3aa-49c0-9922-56718c8081f1 req-eedd427e-e93a-43c5-8e6d-ee42c96e505b service nova] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-61b15ef9-a3aa-49c0-9922-56718c8081f1 req-eedd427e-e93a-43c5-8e6d-ee42c96e505b service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-61b15ef9-a3aa-49c0-9922-56718c8081f1 req-eedd427e-e93a-43c5-8e6d-ee42c96e505b service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-61b15ef9-a3aa-49c0-9922-56718c8081f1 req-eedd427e-e93a-43c5-8e6d-ee42c96e505b service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] No waiting events found dispatching network-vif-unplugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:11 user nova-compute[74482]: WARNING nova.compute.manager [req-61b15ef9-a3aa-49c0-9922-56718c8081f1 req-eedd427e-e93a-43c5-8e6d-ee42c96e505b service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received unexpected event network-vif-unplugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a for instance with vm_state active and task_state reboot_started_hard.
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Instance destroyed successfully.
Oct 23 23:12:11 user nova-compute[74482]: DEBUG nova.objects.instance [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'resources' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-950332835',display_name='tempest-TestMinimumBasicScenario-server-950332835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-950332835',id=22,image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG8dgWQuRHRcLtDLX4CB3F97QOTyGUchFE4KCjIBlG9aoZYNxbOzHcdZhg2VJjRM/RAp+PzivptFgF5OTQl2OLvi7mZOYBYkFv0tzEOK5lfUUpR+6KPBIbQ/TraHJ145g==',key_name='tempest-TestMinimumBasicScenario-439322620',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf59ee373fd04ceda1c9212af985f052',ramdisk_id='',reservation_id='r-t08kgi8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-964628947',owner_user_name='tempest-TestMinimumBasicScenario-964628947-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:12:11Z,user_data=None,user_id='58e1ae75bd484d3ea749e10346671167',uuid=233cb56f-9cce-4c10-94db-cf694a20af1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converting VIF {"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_vif [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb4eca63-00, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74cc15e3-16ee-4638-ba27-0da86bed232f) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:11 user nova-compute[74482]: INFO os_vif [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00')
Oct 23 23:12:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGEpHjuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:12:11 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3504bbd2-af93-47f0-817b-0fb09dc56fa5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:12:11 user nova-compute[74482]: No targets found.
Oct 23 23:12:11 user nova-compute[74482]: iSNS:
Oct 23 23:12:11 user nova-compute[74482]: No targets found.
Oct 23 23:12:11 user nova-compute[74482]: STATIC:
Oct 23 23:12:11 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a
Oct 23 23:12:11 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:12:11 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:12:11 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25
Oct 23 23:12:11 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:12:11 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:12:11 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:12:11 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:12:11 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:12:11 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18
Oct 23 23:12:11 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:12:11 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:12:11 user nova-compute[74482]: FIRMWARE:
Oct 23 23:12:11 user nova-compute[74482]: No targets found.
Oct 23 23:12:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:12:11 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:12:11 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bdf24b-236d-4579-9593-2a32b29343ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lazy-loading 'flavor' on Instance uuid 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a474c415-9761-474d-b96d-78c31bad2974]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:11 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:11 user nova-compute[74482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:11 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:11 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:11 user nova-compute[74482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:11 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:11 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c11ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25'): ({'sdf'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Removing single pathed devices sdf {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f068e229-7966-4fb3-904b-7916e06a2867]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5a9ca97-2e65-44fe-a31f-fb0f60e551cc tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.926s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[be70846d-a863-4e62-9479-cd324d9ff5f3]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Flushing IO for device /dev/sdf {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:12:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b9a116-95b6-440c-a01a-ec3698a58a05]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc5c156-6e6a-4de4-ba7d-bb75e30b90d8]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e445cf8-423a-408c-ab2b-5e8a82f890dd]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bdccb2-2f64-468c-b4b6-3a2d4a0ea812]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260]
Oct 23 23:12:12 user nova-compute[74482]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260] successful.
Oct 23 23:12:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b100d6-a1c8-4a40-a242-4d913c0a02c6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] <== disconnect_volume: return (331ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Start _get_guest_xml network_info=[{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5487da70-f1de-4665-a9d6-6b9ab731970f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '5487da70-f1de-4665-a9d6-6b9ab731970f'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGEpHjuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '233cb56f-9cce-4c10-94db-cf694a20af1f', 'attached_at': '', 'detached_at': '', 'volume_id': '99cdd5d3-493b-47e7-a698-83647110de25', 'serial': '99cdd5d3-493b-47e7-a698-83647110de25'}, 'disk_bus': 'virtio', 'attachment_id': '62fe85b4-1982-4d9a-a666-229c98f0a973', 'boot_index': None, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:12:12 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:12:12 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5487da70-f1de-4665-a9d6-6b9ab731970f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.objects.instance [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'vcpu_model' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.objects.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Object Instance<233cb56f-9cce-4c10-94db-cf694a20af1f> lazy-loaded attributes: resources,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGEpHjuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:12:12 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:12:12 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:12:12 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0487b403-3c26-4531-9db5-196f2909432b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:12:12 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5a8036-71c8-4aca-87b4-856273da239d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25] added
Oct 23 23:12:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[81691526-f48f-4cdf-bffe-cb78f21429de]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efbab2f-3054-4bf0-81e5-e3371d302f97]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGEpHjuK {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UGEpHjuK" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1605f2d2-f9ee-46fc-b96e-ba3361b69279]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UGEpHjuK'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a9279e-d856-4dfd-aa7a-760783fb40c4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21900ba-2184-4047-a130-f131734306f9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17b40e3-b421-4cd2-85ef-8e7167aeae12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260]
Oct 23 23:12:12 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260] successful.
Oct 23 23:12:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e700cd-63ef-4e36-a790-38e9b25a03e7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[95be0984-184d-4e5e-803b-89175226ad3c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[085ab24a-6253-49f2-b25c-b61a2ca51ebd]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-48bbb5db-33a1-49ae-9acd-a10c2c76cced req-8c35395d-8b79-428e-97c6-1ac1b1db2359 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-48bbb5db-33a1-49ae-9acd-a10c2c76cced req-8c35395d-8b79-428e-97c6-1ac1b1db2359 service nova] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-48bbb5db-33a1-49ae-9acd-a10c2c76cced req-8c35395d-8b79-428e-97c6-1ac1b1db2359 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-48bbb5db-33a1-49ae-9acd-a10c2c76cced req-8c35395d-8b79-428e-97c6-1ac1b1db2359 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-48bbb5db-33a1-49ae-9acd-a10c2c76cced req-8c35395d-8b79-428e-97c6-1ac1b1db2359 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] No waiting events found dispatching network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:13 user nova-compute[74482]: WARNING nova.compute.manager [req-48bbb5db-33a1-49ae-9acd-a10c2c76cced req-8c35395d-8b79-428e-97c6-1ac1b1db2359 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received unexpected event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a for instance with vm_state active and task_state reboot_started_hard.
Oct 23 23:12:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGEpHjuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23036333164323764', 'path': '/dev/sde'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036333164323764', 'path': '/dev/sde'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-950332835',display_name='tempest-TestMinimumBasicScenario-server-950332835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-950332835',id=22,image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG8dgWQuRHRcLtDLX4CB3F97QOTyGUchFE4KCjIBlG9aoZYNxbOzHcdZhg2VJjRM/RAp+PzivptFgF5OTQl2OLvi7mZOYBYkFv0tzEOK5lfUUpR+6KPBIbQ/TraHJ145g==',key_name='tempest-TestMinimumBasicScenario-439322620',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf59ee373fd04ceda1c9212af985f052',ramdisk_id='',reservation_id='r-t08kgi8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-964628947',owner_user_name='tempest-TestMinimumBasicScenario-964628947-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:12:11Z,user_data=None,user_id='58e1ae75bd484d3ea749e10346671167',uuid=233cb56f-9cce-4c10-94db-cf694a20af1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converting VIF {"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG nova.objects.instance [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'pci_devices' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG nova.objects.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Object Instance<233cb56f-9cce-4c10-94db-cf694a20af1f> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:12:13 user nova-compute[74482]:   <uuid>233cb56f-9cce-4c10-94db-cf694a20af1f</uuid>
Oct 23 23:12:13 user nova-compute[74482]:   <name>instance-00000016</name>
Oct 23 23:12:13 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:12:13 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:12:13 user nova-compute[74482]:   <metadata>
Oct 23 23:12:13 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:12:13 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:12:13 user nova-compute[74482]:       <nova:name>tempest-TestMinimumBasicScenario-server-950332835</nova:name>
Oct 23 23:12:13 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:12:12</nova:creationTime>
Oct 23 23:12:13 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:12:13 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:12:13 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:12:13 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:12:13 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:12:13 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:12:13 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:12:13 user nova-compute[74482]:       <nova:owner>
Oct 23 23:12:13 user nova-compute[74482]:         <nova:user uuid="58e1ae75bd484d3ea749e10346671167">tempest-TestMinimumBasicScenario-964628947-project-member</nova:user>
Oct 23 23:12:13 user nova-compute[74482]:         <nova:project uuid="cf59ee373fd04ceda1c9212af985f052">tempest-TestMinimumBasicScenario-964628947</nova:project>
Oct 23 23:12:13 user nova-compute[74482]:       </nova:owner>
Oct 23 23:12:13 user nova-compute[74482]:       <nova:root type="image" uuid="5487da70-f1de-4665-a9d6-6b9ab731970f"/>
Oct 23 23:12:13 user nova-compute[74482]:       <nova:ports>
Oct 23 23:12:13 user nova-compute[74482]:         <nova:port uuid="fb4eca63-002e-4eaf-b6ef-f2d6f558f20a">
Oct 23 23:12:13 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 23:12:13 user nova-compute[74482]:         </nova:port>
Oct 23 23:12:13 user nova-compute[74482]:       </nova:ports>
Oct 23 23:12:13 user nova-compute[74482]:     </nova:instance>
Oct 23 23:12:13 user nova-compute[74482]:   </metadata>
Oct 23 23:12:13 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:12:13 user nova-compute[74482]:     <system>
Oct 23 23:12:13 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:12:13 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:12:13 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:12:13 user nova-compute[74482]:       <entry name="serial">233cb56f-9cce-4c10-94db-cf694a20af1f</entry>
Oct 23 23:12:13 user nova-compute[74482]:       <entry name="uuid">233cb56f-9cce-4c10-94db-cf694a20af1f</entry>
Oct 23 23:12:13 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:12:13 user nova-compute[74482]:     </system>
Oct 23 23:12:13 user nova-compute[74482]:   </sysinfo>
Oct 23 23:12:13 user nova-compute[74482]:   <os>
Oct 23 23:12:13 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:12:13 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:12:13 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:12:13 user nova-compute[74482]:   </os>
Oct 23 23:12:13 user nova-compute[74482]:   <features>
Oct 23 23:12:13 user nova-compute[74482]:     <acpi/>
Oct 23 23:12:13 user nova-compute[74482]:     <apic/>
Oct 23 23:12:13 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:12:13 user nova-compute[74482]:   </features>
Oct 23 23:12:13 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:12:13 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:12:13 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:12:13 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:12:13 user nova-compute[74482]:   </clock>
Oct 23 23:12:13 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:12:13 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:12:13 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:12:13 user nova-compute[74482]:   </cpu>
Oct 23 23:12:13 user nova-compute[74482]:   <devices>
Oct 23 23:12:13 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:12:13 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:12:13 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk"/>
Oct 23 23:12:13 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:12:13 user nova-compute[74482]:     </disk>
Oct 23 23:12:13 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:12:13 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:12:13 user nova-compute[74482]:       <source dev="/dev/sde"/>
Oct 23 23:12:13 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:12:13 user nova-compute[74482]:       <serial>99cdd5d3-493b-47e7-a698-83647110de25</serial>
Oct 23 23:12:13 user nova-compute[74482]:     </disk>
Oct 23 23:12:13 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:12:13 user nova-compute[74482]:       <mac address="fa:16:3e:ca:2a:fe"/>
Oct 23 23:12:13 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:12:13 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:12:13 user nova-compute[74482]:       <target dev="tapfb4eca63-00"/>
Oct 23 23:12:13 user nova-compute[74482]:     </interface>
Oct 23 23:12:13 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:12:13 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/console.log" append="off"/>
Oct 23 23:12:13 user nova-compute[74482]:     </serial>
Oct 23 23:12:13 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:12:13 user nova-compute[74482]:     <video>
Oct 23 23:12:13 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:12:13 user nova-compute[74482]:     </video>
Oct 23 23:12:13 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:12:13 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:12:13 user nova-compute[74482]:     </rng>
Oct 23 23:12:13 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:12:13 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:12:13 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:12:13 user nova-compute[74482]:     </memballoon>
Oct 23 23:12:13 user nova-compute[74482]:   </devices>
Oct 23 23:12:13 user nova-compute[74482]: </domain>
Oct 23 23:12:13 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'trusted_certs' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.objects.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Object Instance<233cb56f-9cce-4c10-94db-cf694a20af1f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Cannot resize image /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'migration_context' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.objects.base [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Object Instance<233cb56f-9cce-4c10-94db-cf694a20af1f> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-950332835',display_name='tempest-TestMinimumBasicScenario-server-950332835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-950332835',id=22,image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG8dgWQuRHRcLtDLX4CB3F97QOTyGUchFE4KCjIBlG9aoZYNxbOzHcdZhg2VJjRM/RAp+PzivptFgF5OTQl2OLvi7mZOYBYkFv0tzEOK5lfUUpR+6KPBIbQ/TraHJ145g==',key_name='tempest-TestMinimumBasicScenario-439322620',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='cf59ee373fd04ceda1c9212af985f052',ramdisk_id='',reservation_id='r-t08kgi8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-964628947',owner_user_name='tempest-TestMinimumBasicScenario-964628947-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:12:11Z,user_data=None,user_id='58e1ae75bd484d3ea749e10346671167',uuid=233cb56f-9cce-4c10-94db-cf694a20af1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converting VIF {"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG os_vif [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fc6be90-3432-5fcf-a7f8-f5d469e0b5c4', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb4eca63-00, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb4eca63-00, col_values=(('qos', UUID('4f81978d-39a2-4025-9103-9477d2380cd7')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb4eca63-00, col_values=(('external_ids', {'iface-id': 'fb4eca63-002e-4eaf-b6ef-f2d6f558f20a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:2a:fe', 'vm-uuid': '233cb56f-9cce-4c10-94db-cf694a20af1f'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:14 user nova-compute[74482]: INFO os_vif [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00')
Oct 23 23:12:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquiring lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquiring lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:15 user nova-compute[74482]: INFO nova.compute.manager [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Terminating instance
Oct 23 23:12:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-c5ee62c6-30c6-4e2c-8456-88fda9ee7282 req-add3a963-cb07-4252-8c9c-3ddb32a11151 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received event network-vif-unplugged-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c5ee62c6-30c6-4e2c-8456-88fda9ee7282 req-add3a963-cb07-4252-8c9c-3ddb32a11151 service nova] Acquiring lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c5ee62c6-30c6-4e2c-8456-88fda9ee7282 req-add3a963-cb07-4252-8c9c-3ddb32a11151 service nova] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c5ee62c6-30c6-4e2c-8456-88fda9ee7282 req-add3a963-cb07-4252-8c9c-3ddb32a11151 service nova] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-c5ee62c6-30c6-4e2c-8456-88fda9ee7282 req-add3a963-cb07-4252-8c9c-3ddb32a11151 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] No waiting events found dispatching network-vif-unplugged-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-c5ee62c6-30c6-4e2c-8456-88fda9ee7282 req-add3a963-cb07-4252-8c9c-3ddb32a11151 service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received event network-vif-unplugged-28e912ad-1286-4d27-8b11-6ebb5c68338c for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Instance destroyed successfully.
Oct 23 23:12:16 user nova-compute[74482]: DEBUG nova.objects.instance [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lazy-loading 'resources' on Instance uuid ca2ec70c-36af-46dd-ae94-2abdd17df8ef {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-330894725',display_name='tempest-VolumesNegativeTest-instance-330894725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-330894725',id=23,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:10:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11a466819e0f4beda1d8eb2e135dcfa0',ramdisk_id='',reservation_id='r-s1txjx04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-480598879',owner_user_name='tempest-VolumesNegativeTest-480598879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:10:32Z,user_data=None,user_id='f56901e4ad5741af889eaf09f2702180',uuid=ca2ec70c-36af-46dd-ae94-2abdd17df8ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Converting VIF {"id": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "address": "fa:16:3e:17:a7:5d", "network": {"id": "ab963021-8191-4463-9b81-aedf540ca295", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7e55d11d12fb44cd95955f09699cc673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e912ad-12", "ovs_interfaceid": "28e912ad-1286-4d27-8b11-6ebb5c68338c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=28e912ad-1286-4d27-8b11-6ebb5c68338c,network=Network(ab963021-8191-4463-9b81-aedf540ca295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e912ad-12') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG os_vif [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=28e912ad-1286-4d27-8b11-6ebb5c68338c,network=Network(ab963021-8191-4463-9b81-aedf540ca295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e912ad-12') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28e912ad-12, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=819c458f-7ccc-452b-9416-db5b2fb5afbf) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:16 user nova-compute[74482]: INFO os_vif [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:a7:5d,bridge_name='br-int',has_traffic_filtering=True,id=28e912ad-1286-4d27-8b11-6ebb5c68338c,network=Network(ab963021-8191-4463-9b81-aedf540ca295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e912ad-12')
Oct 23 23:12:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Deleting instance files /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef_del
Oct 23 23:12:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Deletion of /opt/stack/data/nova/instances/ca2ec70c-36af-46dd-ae94-2abdd17df8ef_del complete
Oct 23 23:12:16 user nova-compute[74482]: INFO nova.compute.manager [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 23 23:12:16 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-6cce64ba-676f-48c2-aaef-ed9a6bfd348d req-3ac3d72d-219b-4202-b7e5-c617c8727834 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6cce64ba-676f-48c2-aaef-ed9a6bfd348d req-3ac3d72d-219b-4202-b7e5-c617c8727834 service nova] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6cce64ba-676f-48c2-aaef-ed9a6bfd348d req-3ac3d72d-219b-4202-b7e5-c617c8727834 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6cce64ba-676f-48c2-aaef-ed9a6bfd348d req-3ac3d72d-219b-4202-b7e5-c617c8727834 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-6cce64ba-676f-48c2-aaef-ed9a6bfd348d req-3ac3d72d-219b-4202-b7e5-c617c8727834 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] No waiting events found dispatching network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:16 user nova-compute[74482]: WARNING nova.compute.manager [req-6cce64ba-676f-48c2-aaef-ed9a6bfd348d req-3ac3d72d-219b-4202-b7e5-c617c8727834 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received unexpected event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a for instance with vm_state active and task_state reboot_started_hard.
Oct 23 23:12:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:17 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Took 0.62 seconds to deallocate network for instance.
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-5ee885aa-aace-43f0-9d19-44590d9ddc52 req-9a64ae73-27f6-43fe-a7d4-9677a124afef service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received event network-vif-plugged-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5ee885aa-aace-43f0-9d19-44590d9ddc52 req-9a64ae73-27f6-43fe-a7d4-9677a124afef service nova] Acquiring lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5ee885aa-aace-43f0-9d19-44590d9ddc52 req-9a64ae73-27f6-43fe-a7d4-9677a124afef service nova] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5ee885aa-aace-43f0-9d19-44590d9ddc52 req-9a64ae73-27f6-43fe-a7d4-9677a124afef service nova] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-5ee885aa-aace-43f0-9d19-44590d9ddc52 req-9a64ae73-27f6-43fe-a7d4-9677a124afef service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] No waiting events found dispatching network-vif-plugged-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:17 user nova-compute[74482]: WARNING nova.compute.manager [req-5ee885aa-aace-43f0-9d19-44590d9ddc52 req-9a64ae73-27f6-43fe-a7d4-9677a124afef service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received unexpected event network-vif-plugged-28e912ad-1286-4d27-8b11-6ebb5c68338c for instance with vm_state deleted and task_state None.
Oct 23 23:12:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-5ee885aa-aace-43f0-9d19-44590d9ddc52 req-9a64ae73-27f6-43fe-a7d4-9677a124afef service nova] [instance: ca2ec70c-36af-46dd-ae94-2abdd17df8ef] Received event network-vif-deleted-28e912ad-1286-4d27-8b11-6ebb5c68338c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:17 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Deleted allocations for instance ca2ec70c-36af-46dd-ae94-2abdd17df8ef
Oct 23 23:12:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-88cf5999-c59c-459b-ab52-efd8e1c78cbc tempest-VolumesNegativeTest-480598879 tempest-VolumesNegativeTest-480598879-project-member] Lock "ca2ec70c-36af-46dd-ae94-2abdd17df8ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.717s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:12:18 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Instance rebooted successfully.
Oct 23 23:12:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-95835336-65bf-41c6-918b-4a077e029b97 req-a9666d94-601b-45c8-b0e1-2bbd20da7f05 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95835336-65bf-41c6-918b-4a077e029b97 req-a9666d94-601b-45c8-b0e1-2bbd20da7f05 service nova] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95835336-65bf-41c6-918b-4a077e029b97 req-a9666d94-601b-45c8-b0e1-2bbd20da7f05 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95835336-65bf-41c6-918b-4a077e029b97 req-a9666d94-601b-45c8-b0e1-2bbd20da7f05 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-95835336-65bf-41c6-918b-4a077e029b97 req-a9666d94-601b-45c8-b0e1-2bbd20da7f05 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] No waiting events found dispatching network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:18 user nova-compute[74482]: WARNING nova.compute.manager [req-95835336-65bf-41c6-918b-4a077e029b97 req-a9666d94-601b-45c8-b0e1-2bbd20da7f05 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received unexpected event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a for instance with vm_state active and task_state reboot_started_hard.
Oct 23 23:12:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55ead388-574c-477e-8a09-83ba41362f8d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.527s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:12:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:12:20 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Creating image(s)
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Ensure instance console log exists: /opt/stack/data/nova/instances/c7b69955-1715-4185-8926-12b46b32227d/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Start _get_guest_xml network_info=[{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikLSfjBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7b69955-1715-4185-8926-12b46b32227d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc22b3b7-f89b-4f40-9210-727055244fbe', 'serial': 'bc22b3b7-f89b-4f40-9210-727055244fbe'}, 'disk_bus': 'virtio', 'attachment_id': '121bff9e-bafe-4e3f-8862-7e0cdfb4ecbd', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:12:20 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:12:20 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikLSfjBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:12:20 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:12:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:12:20 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:12:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:12:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:12:20 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:12:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260" returned: 21 in 0.112s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6740f036-056a-4370-9964-553ccf034cbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:12:21 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03d436a-67af-4d96-93ef-280364ef0be0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe] added
Oct 23 23:12:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1ee393-3045-45f2-aaed-d8ddfd90bf3f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aba0eb-f30a-4dc4-9df2-55650123b0b8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikLSfjBs {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikLSfjBs" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b2e189-6319-429d-b29e-51d6cdeccea6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikLSfjBs'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cd6292-e4e4-4d34-a21f-959214cf3b31]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef49103-ab4c-40a5-be43-47a4ef8ae15d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc3f94a-2292-4173-b9b8-414761181325]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260]
Oct 23 23:12:21 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260] successful.
Oct 23 23:12:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eee78e6-5068-4631-a572-2aa990db8a0f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8290e3ea-2186-48bb-a822-cc28cb184430]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:12:21 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:21 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.470s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e7433c-d88b-4316-838a-a867829bb9cd]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikLSfjBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.532s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== connect_volume: return (1534ms) {'type': 'block', 'scsi_wwn': '23834313930303834', 'path': '/dev/sdf'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834313930303834', 'path': '/dev/sdf'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1502585542',display_name='tempest-ServerActionsTestOtherA-server-1502585542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1502585542',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIFqjOSyUZWQsU5gFsbXrBOoj4Cp26qpoZb6ZuADPp+mJaMBG92ILD46Qtgf0LpXdVLgOqmH/QEGrVpFM/l9sAP2h6k2MXu+chElwiN2sa7paHBVT+RCfDr3O/3kW7sqg==',key_name='tempest-keypair-1686845388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-8rr9kvp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:12:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=c7b69955-1715-4185-8926-12b46b32227d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'pci_devices' on Instance uuid c7b69955-1715-4185-8926-12b46b32227d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:12:22 user nova-compute[74482]:   <uuid>c7b69955-1715-4185-8926-12b46b32227d</uuid>
Oct 23 23:12:22 user nova-compute[74482]:   <name>instance-00000019</name>
Oct 23 23:12:22 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:12:22 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:12:22 user nova-compute[74482]:   <metadata>
Oct 23 23:12:22 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:12:22 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:12:22 user nova-compute[74482]:       <nova:name>tempest-ServerActionsTestOtherA-server-1502585542</nova:name>
Oct 23 23:12:22 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:12:20</nova:creationTime>
Oct 23 23:12:22 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:12:22 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:12:22 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:12:22 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:12:22 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:12:22 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:12:22 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:12:22 user nova-compute[74482]:       <nova:owner>
Oct 23 23:12:22 user nova-compute[74482]:         <nova:user uuid="a6e62933fe47479baf3029e44d3b8759">tempest-ServerActionsTestOtherA-1928343369-project-member</nova:user>
Oct 23 23:12:22 user nova-compute[74482]:         <nova:project uuid="7418b41ef984478daf12ce3a2c72c3c6">tempest-ServerActionsTestOtherA-1928343369</nova:project>
Oct 23 23:12:22 user nova-compute[74482]:       </nova:owner>
Oct 23 23:12:22 user nova-compute[74482]:       <nova:ports>
Oct 23 23:12:22 user nova-compute[74482]:         <nova:port uuid="ff82f9a6-5f42-4e98-b4df-93bbfb502665">
Oct 23 23:12:22 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 23:12:22 user nova-compute[74482]:         </nova:port>
Oct 23 23:12:22 user nova-compute[74482]:       </nova:ports>
Oct 23 23:12:22 user nova-compute[74482]:     </nova:instance>
Oct 23 23:12:22 user nova-compute[74482]:   </metadata>
Oct 23 23:12:22 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:12:22 user nova-compute[74482]:     <system>
Oct 23 23:12:22 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:12:22 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:12:22 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:12:22 user nova-compute[74482]:       <entry name="serial">c7b69955-1715-4185-8926-12b46b32227d</entry>
Oct 23 23:12:22 user nova-compute[74482]:       <entry name="uuid">c7b69955-1715-4185-8926-12b46b32227d</entry>
Oct 23 23:12:22 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:12:22 user nova-compute[74482]:     </system>
Oct 23 23:12:22 user nova-compute[74482]:   </sysinfo>
Oct 23 23:12:22 user nova-compute[74482]:   <os>
Oct 23 23:12:22 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:12:22 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:12:22 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:12:22 user nova-compute[74482]:   </os>
Oct 23 23:12:22 user nova-compute[74482]:   <features>
Oct 23 23:12:22 user nova-compute[74482]:     <acpi/>
Oct 23 23:12:22 user nova-compute[74482]:     <apic/>
Oct 23 23:12:22 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:12:22 user nova-compute[74482]:   </features>
Oct 23 23:12:22 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:12:22 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:12:22 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:12:22 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:12:22 user nova-compute[74482]:   </clock>
Oct 23 23:12:22 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:12:22 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:12:22 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:12:22 user nova-compute[74482]:   </cpu>
Oct 23 23:12:22 user nova-compute[74482]:   <devices>
Oct 23 23:12:22 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:12:22 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:12:22 user nova-compute[74482]:       <source dev="/dev/sdf"/>
Oct 23 23:12:22 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:12:22 user nova-compute[74482]:       <serial>bc22b3b7-f89b-4f40-9210-727055244fbe</serial>
Oct 23 23:12:22 user nova-compute[74482]:     </disk>
Oct 23 23:12:22 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:12:22 user nova-compute[74482]:       <mac address="fa:16:3e:96:ad:04"/>
Oct 23 23:12:22 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:12:22 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:12:22 user nova-compute[74482]:       <target dev="tapff82f9a6-5f"/>
Oct 23 23:12:22 user nova-compute[74482]:     </interface>
Oct 23 23:12:22 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:12:22 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/c7b69955-1715-4185-8926-12b46b32227d/console.log" append="off"/>
Oct 23 23:12:22 user nova-compute[74482]:     </serial>
Oct 23 23:12:22 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:12:22 user nova-compute[74482]:     <video>
Oct 23 23:12:22 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:12:22 user nova-compute[74482]:     </video>
Oct 23 23:12:22 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:12:22 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:12:22 user nova-compute[74482]:     </rng>
Oct 23 23:12:22 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:12:22 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:12:22 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:12:22 user nova-compute[74482]:     </memballoon>
Oct 23 23:12:22 user nova-compute[74482]:   </devices>
Oct 23 23:12:22 user nova-compute[74482]: </domain>
Oct 23 23:12:22 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1502585542',display_name='tempest-ServerActionsTestOtherA-server-1502585542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1502585542',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIFqjOSyUZWQsU5gFsbXrBOoj4Cp26qpoZb6ZuADPp+mJaMBG92ILD46Qtgf0LpXdVLgOqmH/QEGrVpFM/l9sAP2h6k2MXu+chElwiN2sa7paHBVT+RCfDr3O/3kW7sqg==',key_name='tempest-keypair-1686845388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-8rr9kvp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:12:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=c7b69955-1715-4185-8926-12b46b32227d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG os_vif [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '261c0de8-27f6-571f-8d22-168f1994f15b', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff82f9a6-5f, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff82f9a6-5f, col_values=(('qos', UUID('a58d10d4-0116-4b84-ae0a-49cbdaea4a23')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff82f9a6-5f, col_values=(('external_ids', {'iface-id': 'ff82f9a6-5f42-4e98-b4df-93bbfb502665', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:ad:04', 'vm-uuid': 'c7b69955-1715-4185-8926-12b46b32227d'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:22 user nova-compute[74482]: INFO os_vif [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f')
Oct 23 23:12:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.362s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No VIF found with MAC fa:16:3e:96:ad:04, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:12:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:12:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-0a91c7ff-55cf-480c-aec5-5720639be655 req-806d490f-030e-4e6f-b2c0-8cae2fa77098 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0a91c7ff-55cf-480c-aec5-5720639be655 req-806d490f-030e-4e6f-b2c0-8cae2fa77098 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0a91c7ff-55cf-480c-aec5-5720639be655 req-806d490f-030e-4e6f-b2c0-8cae2fa77098 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0a91c7ff-55cf-480c-aec5-5720639be655 req-806d490f-030e-4e6f-b2c0-8cae2fa77098 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-0a91c7ff-55cf-480c-aec5-5720639be655 req-806d490f-030e-4e6f-b2c0-8cae2fa77098 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:26 user nova-compute[74482]: WARNING nova.compute.manager [req-0a91c7ff-55cf-480c-aec5-5720639be655 req-806d490f-030e-4e6f-b2c0-8cae2fa77098 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state building and task_state spawning.
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-ca280756-9512-4ebf-a1b9-3091e694586e req-00d71a4a-2070-4a82-8142-5e520197bf09 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ca280756-9512-4ebf-a1b9-3091e694586e req-00d71a4a-2070-4a82-8142-5e520197bf09 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ca280756-9512-4ebf-a1b9-3091e694586e req-00d71a4a-2070-4a82-8142-5e520197bf09 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ca280756-9512-4ebf-a1b9-3091e694586e req-00d71a4a-2070-4a82-8142-5e520197bf09 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-ca280756-9512-4ebf-a1b9-3091e694586e req-00d71a4a-2070-4a82-8142-5e520197bf09 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:27 user nova-compute[74482]: WARNING nova.compute.manager [req-ca280756-9512-4ebf-a1b9-3091e694586e req-00d71a4a-2070-4a82-8142-5e520197bf09 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state building and task_state spawning.
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:12:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:12:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7668MB free_disk=24.930278778076172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:27 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: c7b69955-1715-4185-8926-12b46b32227d] Instance spawned successfully.
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:27 user nova-compute[74482]: INFO nova.compute.manager [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Terminating instance
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: INFO nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Took 6.42 seconds to spawn the instance on the hypervisor.
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 1718ea62-105b-44ac-80f6-587224314449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance a18c958b-f7d9-47ba-ad98-332e12838d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 599b9f36-af3c-405a-ae1d-088325a1fa03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 233cb56f-9cce-4c10-94db-cf694a20af1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 095c2860-554f-4622-902d-8cafda6dbfe9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7b69955-1715-4185-8926-12b46b32227d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:12:27 user nova-compute[74482]: INFO nova.compute.manager [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Took 27.81 seconds to build instance.
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c333734f-e842-44a5-9e75-b821dee9e165 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.926s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:12:27 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 1718ea62-105b-44ac-80f6-587224314449] Instance destroyed successfully.
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lazy-loading 'resources' on Instance uuid 1718ea62-105b-44ac-80f6-587224314449 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.920s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1548022627',display_name='tempest-VolumesAdminNegativeTest-server-1548022627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1548022627',id=17,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNu1SU0w1gzobQN6TU32JuWzmctnwzQt4Sqf/HRd8Y31ohePul8TSf3/FdwfClpUSReVOHK/kMrRwYFrFvLC3TKSMy1O4Mu+hrsQQTzAuK073EjPYkMkW/gdKgeH6ioBsQ==',key_name='tempest-keypair-512399428',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:06:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98b95877b43e4d458fd124f0ae506aaf',ramdisk_id='',reservation_id='r-cylr31on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1781155714',owner_user_name='tempest-VolumesAdminNegativeTest-1781155714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f2f6cc277224a04a377fc0bfc3b5021',uuid=1718ea62-105b-44ac-80f6-587224314449,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converting VIF {"id": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "address": "fa:16:3e:37:12:4f", "network": {"id": "a3782ace-ec9f-4233-bf87-045b10d8415c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1193787701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98b95877b43e4d458fd124f0ae506aaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31b56e-df", "ovs_interfaceid": "4c31b56e-df70-475c-a0fc-7c5c1be07e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:12:4f,bridge_name='br-int',has_traffic_filtering=True,id=4c31b56e-df70-475c-a0fc-7c5c1be07e26,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31b56e-df') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG os_vif [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:12:4f,bridge_name='br-int',has_traffic_filtering=True,id=4c31b56e-df70-475c-a0fc-7c5c1be07e26,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31b56e-df') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c31b56e-df, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ede0b1b-bc01-46cd-b64f-c92225918c45) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:28 user nova-compute[74482]: INFO os_vif [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:12:4f,bridge_name='br-int',has_traffic_filtering=True,id=4c31b56e-df70-475c-a0fc-7c5c1be07e26,network=Network(a3782ace-ec9f-4233-bf87-045b10d8415c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31b56e-df')
Oct 23 23:12:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Deleting instance files /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449_del
Oct 23 23:12:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Deletion of /opt/stack/data/nova/instances/1718ea62-105b-44ac-80f6-587224314449_del complete
Oct 23 23:12:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-a4947abd-a333-4207-bd35-de80d2a9772f req-c636643e-8505-45b7-afba-b55413f45448 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received event network-vif-unplugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a4947abd-a333-4207-bd35-de80d2a9772f req-c636643e-8505-45b7-afba-b55413f45448 service nova] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a4947abd-a333-4207-bd35-de80d2a9772f req-c636643e-8505-45b7-afba-b55413f45448 service nova] Lock "1718ea62-105b-44ac-80f6-587224314449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a4947abd-a333-4207-bd35-de80d2a9772f req-c636643e-8505-45b7-afba-b55413f45448 service nova] Lock "1718ea62-105b-44ac-80f6-587224314449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-a4947abd-a333-4207-bd35-de80d2a9772f req-c636643e-8505-45b7-afba-b55413f45448 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] No waiting events found dispatching network-vif-unplugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-a4947abd-a333-4207-bd35-de80d2a9772f req-c636643e-8505-45b7-afba-b55413f45448 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received event network-vif-unplugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:12:28 user nova-compute[74482]: INFO nova.compute.manager [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] [instance: 1718ea62-105b-44ac-80f6-587224314449] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 23 23:12:28 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:12:28 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 1718ea62-105b-44ac-80f6-587224314449] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:12:28 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 1718ea62-105b-44ac-80f6-587224314449] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:12:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:29 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 1718ea62-105b-44ac-80f6-587224314449] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:29 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 1718ea62-105b-44ac-80f6-587224314449] Took 1.03 seconds to deallocate network for instance.
Oct 23 23:12:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-552e6993-b56d-4097-82c6-16198e534574 req-0357ddc5-0789-48b0-b52a-35d59966dd93 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received event network-vif-deleted-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:29 user nova-compute[74482]: INFO nova.compute.manager [req-552e6993-b56d-4097-82c6-16198e534574 req-0357ddc5-0789-48b0-b52a-35d59966dd93 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Neutron deleted interface 4c31b56e-df70-475c-a0fc-7c5c1be07e26; detaching it from the instance and deleting it from the info cache
Oct 23 23:12:29 user nova-compute[74482]: DEBUG nova.network.neutron [req-552e6993-b56d-4097-82c6-16198e534574 req-0357ddc5-0789-48b0-b52a-35d59966dd93 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-552e6993-b56d-4097-82c6-16198e534574 req-0357ddc5-0789-48b0-b52a-35d59966dd93 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Detach interface failed, port_id=4c31b56e-df70-475c-a0fc-7c5c1be07e26, reason: Instance 1718ea62-105b-44ac-80f6-587224314449 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:12:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:29 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:12:29 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:12:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:29 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Deleted allocations for instance 1718ea62-105b-44ac-80f6-587224314449
Oct 23 23:12:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d371e48a-eb17-490a-8455-73d670d7ff38 tempest-VolumesAdminNegativeTest-1781155714 tempest-VolumesAdminNegativeTest-1781155714-project-member] Lock "1718ea62-105b-44ac-80f6-587224314449" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.827s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-b6c79435-850b-4784-aae6-89c36ae6be39 req-7e2655c8-102d-4079-9188-2c7417319a88 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received event network-vif-plugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b6c79435-850b-4784-aae6-89c36ae6be39 req-7e2655c8-102d-4079-9188-2c7417319a88 service nova] Acquiring lock "1718ea62-105b-44ac-80f6-587224314449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b6c79435-850b-4784-aae6-89c36ae6be39 req-7e2655c8-102d-4079-9188-2c7417319a88 service nova] Lock "1718ea62-105b-44ac-80f6-587224314449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b6c79435-850b-4784-aae6-89c36ae6be39 req-7e2655c8-102d-4079-9188-2c7417319a88 service nova] Lock "1718ea62-105b-44ac-80f6-587224314449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-b6c79435-850b-4784-aae6-89c36ae6be39 req-7e2655c8-102d-4079-9188-2c7417319a88 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] No waiting events found dispatching network-vif-plugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:30 user nova-compute[74482]: WARNING nova.compute.manager [req-b6c79435-850b-4784-aae6-89c36ae6be39 req-7e2655c8-102d-4079-9188-2c7417319a88 service nova] [instance: 1718ea62-105b-44ac-80f6-587224314449] Received unexpected event network-vif-plugged-4c31b56e-df70-475c-a0fc-7c5c1be07e26 for instance with vm_state deleted and task_state None.
Oct 23 23:12:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:36 user nova-compute[74482]: INFO nova.compute.manager [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Rescuing
Oct 23 23:12:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:12:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquired lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:12:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:12:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Updating instance_info_cache with network_info: [{"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Releasing lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG nova.compute.manager [req-5d262837-cf68-47b0-bdf0-a5990686b3c1 req-4dfb3200-ef7e-44f6-a212-321f83d61e4e service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-unplugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5d262837-cf68-47b0-bdf0-a5990686b3c1 req-4dfb3200-ef7e-44f6-a212-321f83d61e4e service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5d262837-cf68-47b0-bdf0-a5990686b3c1 req-4dfb3200-ef7e-44f6-a212-321f83d61e4e service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5d262837-cf68-47b0-bdf0-a5990686b3c1 req-4dfb3200-ef7e-44f6-a212-321f83d61e4e service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG nova.compute.manager [req-5d262837-cf68-47b0-bdf0-a5990686b3c1 req-4dfb3200-ef7e-44f6-a212-321f83d61e4e service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-unplugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:37 user nova-compute[74482]: WARNING nova.compute.manager [req-5d262837-cf68-47b0-bdf0-a5990686b3c1 req-4dfb3200-ef7e-44f6-a212-321f83d61e4e service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-unplugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state active and task_state rescuing.
Oct 23 23:12:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Instance destroyed successfully.
Oct 23 23:12:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Attempting a stable device rescue
Oct 23 23:12:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 23:12:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Instance directory exists: not creating {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 23:12:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Creating image(s)
Oct 23 23:12:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "/opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "/opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "/opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:38 user nova-compute[74482]: DEBUG nova.objects.instance [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'trusted_certs' on Instance uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "296794b320af4cfe4f2169c6143fa6260aceff74" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "296794b320af4cfe4f2169c6143fa6260aceff74" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG nova.virt.images [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] 1d76443b-8fc0-435a-976a-5df5f694396f was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74.part /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-3ed7f196-2f49-42f8-a146-1824c1a525f5 req-aca4af28-2260-4d6e-98e5-c00793522742 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3ed7f196-2f49-42f8-a146-1824c1a525f5 req-aca4af28-2260-4d6e-98e5-c00793522742 service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3ed7f196-2f49-42f8-a146-1824c1a525f5 req-aca4af28-2260-4d6e-98e5-c00793522742 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3ed7f196-2f49-42f8-a146-1824c1a525f5 req-aca4af28-2260-4d6e-98e5-c00793522742 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-3ed7f196-2f49-42f8-a146-1824c1a525f5 req-aca4af28-2260-4d6e-98e5-c00793522742 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:39 user nova-compute[74482]: WARNING nova.compute.manager [req-3ed7f196-2f49-42f8-a146-1824c1a525f5 req-aca4af28-2260-4d6e-98e5-c00793522742 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state active and task_state rescuing.
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74.part /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74.converted" returned: 0 in 0.794s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:40 user nova-compute[74482]: INFO nova.compute.manager [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Terminating instance
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "296794b320af4cfe4f2169c6143fa6260aceff74" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.347s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "296794b320af4cfe4f2169c6143fa6260aceff74" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "296794b320af4cfe4f2169c6143fa6260aceff74" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74 --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74,backing_fmt=raw /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74,backing_fmt=raw /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue" returned: 0 in 0.058s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "296794b320af4cfe4f2169c6143fa6260aceff74" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.objects.instance [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'migration_context' on Instance uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.objects.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<095c2860-554f-4622-902d-8cafda6dbfe9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Start _get_guest_xml network_info=[{"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "vif_mac": "fa:16:3e:2e:f4:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1d76443b-8fc0-435a-976a-5df5f694396f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkpgPTXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '095c2860-554f-4622-902d-8cafda6dbfe9', 'attached_at': '', 'detached_at': '', 'volume_id': '55f404ac-63d4-4371-98ad-8de4f7c82d18', 'serial': '55f404ac-63d4-4371-98ad-8de4f7c82d18'}, 'disk_bus': 'virtio', 'attachment_id': 'b3164928-165d-4f4d-b579-ded300eb02cb', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.objects.instance [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'resources' on Instance uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.objects.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<095c2860-554f-4622-902d-8cafda6dbfe9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.objects.instance [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'numa_topology' on Instance uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.objects.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<095c2860-554f-4622-902d-8cafda6dbfe9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:12:40 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:12:40 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.objects.instance [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'vcpu_model' on Instance uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:40 user nova-compute[74482]: DEBUG nova.objects.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<095c2860-554f-4622-902d-8cafda6dbfe9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkpgPTXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:12:41 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:12:41 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:12:41 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[564a3be4-c68c-4c04-8092-5d01228e9d07]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rkpgPTXI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 23:12:41 user nova-compute[74482]: node.name = iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18
Oct 23 23:12:41 user nova-compute[74482]: node.tpgt = -1
Oct 23 23:12:41 user nova-compute[74482]: node.startup = automatic
Oct 23 23:12:41 user nova-compute[74482]: node.leading_login = No
Oct 23 23:12:41 user nova-compute[74482]: iface.iscsi_ifacename = default
Oct 23 23:12:41 user nova-compute[74482]: iface.net_ifacename = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.ipaddress = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.prefix_len = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.hwaddress = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.transport_name = tcp
Oct 23 23:12:41 user nova-compute[74482]: iface.initiatorname = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.state = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.vlan_id = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.vlan_priority = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.vlan_state = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.iface_num = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.mtu = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.port = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.bootproto = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.subnet_mask = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.gateway = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.dhcp_alt_client_id = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.dhcp_dns = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.dhcp_learn_iqn = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.dhcp_vendor_id_state = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.dhcp_vendor_id = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.dhcp_slp_da = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.fragmentation = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.gratuitous_arp = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.incoming_forwarding = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.tos_state = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.tos = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.ttl = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.delayed_ack = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.tcp_nagle = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.tcp_wsf_state = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.tcp_wsf = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.tcp_timer_scale = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.tcp_timestamp = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.redirect = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.def_task_mgmt_timeout = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.header_digest = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.data_digest = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.immediate_data = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.initial_r2t = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.data_seq_inorder = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.data_pdu_inorder = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.erl = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.max_receive_data_len = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.first_burst_len = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.max_outstanding_r2t = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.max_burst_len = 0
Oct 23 23:12:41 user nova-compute[74482]: iface.chap_auth = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.bidi_chap = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.strict_login_compliance = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.discovery_auth = <empty>
Oct 23 23:12:41 user nova-compute[74482]: iface.discovery_logout = <empty>
Oct 23 23:12:41 user nova-compute[74482]: node.discovery_address = <empty>
Oct 23 23:12:41 user nova-compute[74482]: node.discovery_port = 0
Oct 23 23:12:41 user nova-compute[74482]: node.discovery_type = static
Oct 23 23:12:41 user nova-compute[74482]: node.session.initial_cmdsn = 0
Oct 23 23:12:41 user nova-compute[74482]: node.session.initial_login_retry_max = 8
Oct 23 23:12:41 user nova-compute[74482]: node.session.xmit_thread_priority = -20
Oct 23 23:12:41 user nova-compute[74482]: node.session.cmds_max = 128
Oct 23 23:12:41 user nova-compute[74482]: node.session.queue_depth = 32
Oct 23 23:12:41 user nova-compute[74482]: node.session.nr_sessions = 1
Oct 23 23:12:41 user nova-compute[74482]: node.session.auth.authmethod = CHAP
Oct 23 23:12:41 user nova-compute[74482]: node.session.auth.username = rkpgPTXI
Oct 23 23:12:41 user nova-compute[74482]: node.session.auth.password = ***
Oct 23 23:12:41 user nova-compute[74482]: node.session.auth.username_in = <empty>
Oct 23 23:12:41 user nova-compute[74482]: node.session.auth.password_in = <empty>
Oct 23 23:12:41 user nova-compute[74482]: node.session.auth.chap_algs = MD5
Oct 23 23:12:41 user nova-compute[74482]: node.session.timeo.replacement_timeout = 120
Oct 23 23:12:41 user nova-compute[74482]: node.session.err_timeo.abort_timeout = 15
Oct 23 23:12:41 user nova-compute[74482]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 23:12:41 user nova-compute[74482]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 23:12:41 user nova-compute[74482]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.FastAbort = Yes
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.InitialR2T = No
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.ImmediateData = Yes
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.MaxConnections = 1
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 23:12:41 user nova-compute[74482]: node.session.iscsi.ERL = 0
Oct 23 23:12:41 user nova-compute[74482]: node.session.scan = manual
Oct 23 23:12:41 user nova-compute[74482]: node.session.reopen_max = 0
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].address = 172.16.0.220
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].port = 3260
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].startup = manual
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].tcp.window_size = 524288
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].tcp.type_of_service = 0
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].timeo.logout_timeout = 15
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].timeo.login_timeout = 15
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].timeo.auth_timeout = 45
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].iscsi.DataDigest = None
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].iscsi.IFMarker = No
Oct 23 23:12:41 user nova-compute[74482]: node.conn[0].iscsi.OFMarker = No
Oct 23 23:12:41 user nova-compute[74482]: # END RECORD
Oct 23 23:12:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19b4237-0f1b-47b3-aceb-b7d4ed54a271]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[273f2f53-dab4-4cc7-9361-2ed99ab2f87f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkpgPTXI {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkpgPTXI" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a2dc06-01a6-4ca4-b27c-5df6652443f5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkpgPTXI'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bbb3ae-e11f-48e9-91b4-ef673ce387de]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f936b0-3c52-48c0-bc21-8a0a81e929d0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:41 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:41 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:41 user nova-compute[74482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:12:41 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:12:41 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:12:41 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:12:41 user nova-compute[74482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:12:41 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:12:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] HCTL ('33', '0', '0', 0) found on session 26 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcf776b-56a5-4eba-a2ef-0008583c8b10]: (4, ('0 0 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Searching for a device in session 26 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkpgPTXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.199s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] <== connect_volume: return (201ms) {'type': 'block', 'scsi_wwn': '23632623064343039', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632623064343039', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1298325207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1298325207',id=24,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:11:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-3l14jumo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:11:28Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=095c2860-554f-4622-902d-8cafda6dbfe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "vif_mac": "fa:16:3e:2e:f4:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "vif_mac": "fa:16:3e:2e:f4:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f4:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f475537-5a5a-4a04-acf9-d114075b47c2,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f475537-5a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.objects.instance [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'pci_devices' on Instance uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.objects.base [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Object Instance<095c2860-554f-4622-902d-8cafda6dbfe9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:12:41 user nova-compute[74482]:   <uuid>095c2860-554f-4622-902d-8cafda6dbfe9</uuid>
Oct 23 23:12:41 user nova-compute[74482]:   <name>instance-00000018</name>
Oct 23 23:12:41 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:12:41 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:12:41 user nova-compute[74482]:   <metadata>
Oct 23 23:12:41 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:12:41 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:12:41 user nova-compute[74482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1298325207</nova:name>
Oct 23 23:12:41 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:12:40</nova:creationTime>
Oct 23 23:12:41 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:12:41 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:12:41 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:12:41 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:12:41 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:12:41 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:12:41 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:12:41 user nova-compute[74482]:       <nova:owner>
Oct 23 23:12:41 user nova-compute[74482]:         <nova:user uuid="ebd17d342e7145e0bad04188ec8be780">tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member</nova:user>
Oct 23 23:12:41 user nova-compute[74482]:         <nova:project uuid="981f084ec65e4fa0a9cbd2e5edf8302a">tempest-ServerBootFromVolumeStableRescueTest-157113739</nova:project>
Oct 23 23:12:41 user nova-compute[74482]:       </nova:owner>
Oct 23 23:12:41 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:12:41 user nova-compute[74482]:       <nova:ports>
Oct 23 23:12:41 user nova-compute[74482]:         <nova:port uuid="9f475537-5a5a-4a04-acf9-d114075b47c2">
Oct 23 23:12:41 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 23:12:41 user nova-compute[74482]:         </nova:port>
Oct 23 23:12:41 user nova-compute[74482]:       </nova:ports>
Oct 23 23:12:41 user nova-compute[74482]:     </nova:instance>
Oct 23 23:12:41 user nova-compute[74482]:   </metadata>
Oct 23 23:12:41 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:12:41 user nova-compute[74482]:     <system>
Oct 23 23:12:41 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:12:41 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:12:41 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:12:41 user nova-compute[74482]:       <entry name="serial">095c2860-554f-4622-902d-8cafda6dbfe9</entry>
Oct 23 23:12:41 user nova-compute[74482]:       <entry name="uuid">095c2860-554f-4622-902d-8cafda6dbfe9</entry>
Oct 23 23:12:41 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:12:41 user nova-compute[74482]:     </system>
Oct 23 23:12:41 user nova-compute[74482]:   </sysinfo>
Oct 23 23:12:41 user nova-compute[74482]:   <os>
Oct 23 23:12:41 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:12:41 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:12:41 user nova-compute[74482]:   </os>
Oct 23 23:12:41 user nova-compute[74482]:   <features>
Oct 23 23:12:41 user nova-compute[74482]:     <acpi/>
Oct 23 23:12:41 user nova-compute[74482]:     <apic/>
Oct 23 23:12:41 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:12:41 user nova-compute[74482]:   </features>
Oct 23 23:12:41 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:12:41 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:12:41 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:12:41 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:12:41 user nova-compute[74482]:   </clock>
Oct 23 23:12:41 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:12:41 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:12:41 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:12:41 user nova-compute[74482]:   </cpu>
Oct 23 23:12:41 user nova-compute[74482]:   <devices>
Oct 23 23:12:41 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:12:41 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:12:41 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:12:41 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:12:41 user nova-compute[74482]:       <serial>55f404ac-63d4-4371-98ad-8de4f7c82d18</serial>
Oct 23 23:12:41 user nova-compute[74482]:     </disk>
Oct 23 23:12:41 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:12:41 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:12:41 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue"/>
Oct 23 23:12:41 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:12:41 user nova-compute[74482]:       <boot order="1"/>
Oct 23 23:12:41 user nova-compute[74482]:     </disk>
Oct 23 23:12:41 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:12:41 user nova-compute[74482]:       <mac address="fa:16:3e:2e:f4:4b"/>
Oct 23 23:12:41 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:12:41 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:12:41 user nova-compute[74482]:       <target dev="tap9f475537-5a"/>
Oct 23 23:12:41 user nova-compute[74482]:     </interface>
Oct 23 23:12:41 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:12:41 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/console.log" append="off"/>
Oct 23 23:12:41 user nova-compute[74482]:     </serial>
Oct 23 23:12:41 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:12:41 user nova-compute[74482]:     <video>
Oct 23 23:12:41 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:12:41 user nova-compute[74482]:     </video>
Oct 23 23:12:41 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:12:41 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:12:41 user nova-compute[74482]:     </rng>
Oct 23 23:12:41 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:12:41 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:12:41 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:12:41 user nova-compute[74482]:     </memballoon>
Oct 23 23:12:41 user nova-compute[74482]:   </devices>
Oct 23 23:12:41 user nova-compute[74482]: </domain>
Oct 23 23:12:41 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:12:41 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Instance destroyed successfully.
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lazy-loading 'resources' on Instance uuid 599b9f36-af3c-405a-ae1d-088325a1fa03 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:08:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1089684976',display_name='tempest-TestServerVolumeAttachmentScenario-server-1089684976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1089684976',id=20,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNc3K/1HvzPM/a+VdICuI/wtcveUjdvn81ueHIzr0eCB2BfGHlMKkRQErW/JLJg2TSSbnXjurZd+kyHlaGaoxtbxTrwias2gqdL2O/IEeIRKAhq1upREg4Xn8Un4OSd1Lw==',key_name='tempest-keypair-194814383',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:08:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc2e631e89fe4d90a2fceb55819e0c9e',ramdisk_id='',reservation_id='r-624v4tvn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-379192400',owner_user_name='tempest-TestServerVolumeAttachmentScenario-379192400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f238e70c3ce4b7d9dc694d886fd3613',uuid=599b9f36-af3c-405a-ae1d-088325a1fa03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Converting VIF {"id": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "address": "fa:16:3e:99:fd:fe", "network": {"id": "e61d1e0b-5058-4589-8ea1-a8fb1690073d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-204672709-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2e631e89fe4d90a2fceb55819e0c9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1429e61f-b7", "ovs_interfaceid": "1429e61f-b7da-46a7-a714-d6c68b8b8c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:fd:fe,bridge_name='br-int',has_traffic_filtering=True,id=1429e61f-b7da-46a7-a714-d6c68b8b8c5f,network=Network(e61d1e0b-5058-4589-8ea1-a8fb1690073d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1429e61f-b7') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG os_vif [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:fd:fe,bridge_name='br-int',has_traffic_filtering=True,id=1429e61f-b7da-46a7-a714-d6c68b8b8c5f,network=Network(e61d1e0b-5058-4589-8ea1-a8fb1690073d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1429e61f-b7') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1429e61f-b7, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:41 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Instance destroyed successfully.
Oct 23 23:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=651e5aea-245b-4f2f-bcee-66425443445b) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:41 user nova-compute[74482]: INFO os_vif [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:fd:fe,bridge_name='br-int',has_traffic_filtering=True,id=1429e61f-b7da-46a7-a714-d6c68b8b8c5f,network=Network(e61d1e0b-5058-4589-8ea1-a8fb1690073d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1429e61f-b7')
Oct 23 23:12:41 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Deleting instance files /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03_del
Oct 23 23:12:41 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Deletion of /opt/stack/data/nova/instances/599b9f36-af3c-405a-ae1d-088325a1fa03_del complete
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] No VIF found with MAC fa:16:3e:2e:f4:4b, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:12:41 user nova-compute[74482]: INFO nova.compute.manager [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received event network-vif-unplugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] No waiting events found dispatching network-vif-unplugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received event network-vif-unplugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received event network-vif-plugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] Acquiring lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] No waiting events found dispatching network-vif-plugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:41 user nova-compute[74482]: WARNING nova.compute.manager [req-78174aa1-b763-4ec2-972b-909bbe0d44bd req-807da277-1bc1-4daf-8cfc-ba26115f6cc8 service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received unexpected event network-vif-plugged-1429e61f-b7da-46a7-a714-d6c68b8b8c5f for instance with vm_state active and task_state deleting.
Oct 23 23:12:42 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:12:42 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Took 1.09 seconds to deallocate network for instance.
Oct 23 23:12:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:43 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Deleted allocations for instance 599b9f36-af3c-405a-ae1d-088325a1fa03
Oct 23 23:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7fe1f949-da62-44c8-90ac-bbdc4cda6932 tempest-TestServerVolumeAttachmentScenario-379192400 tempest-TestServerVolumeAttachmentScenario-379192400-project-member] Lock "599b9f36-af3c-405a-ae1d-088325a1fa03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.729s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] [instance: 599b9f36-af3c-405a-ae1d-088325a1fa03] Received event network-vif-deleted-1429e61f-b7da-46a7-a714-d6c68b8b8c5f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:43 user nova-compute[74482]: WARNING nova.compute.manager [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state active and task_state rescuing.
Oct 23 23:12:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:12:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:12:43 user nova-compute[74482]: WARNING nova.compute.manager [req-54465b57-eef1-46f0-a028-10188f5ba12f req-246cdec6-898f-4f71-91b9-6842957d0c0c service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state active and task_state rescuing.
Oct 23 23:12:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-39f34138-3ada-4f75-b16f-f440577f0b27 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:12:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:12:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:13:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:13:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquired lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:13:06 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:13:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'info_cache' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:13:06 user nova-compute[74482]: DEBUG nova.objects.base [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updating instance_info_cache with network_info: [{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Releasing lock "refresh_cache-bbedc3ec-0f54-4977-8546-41ce4f488641" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:13:07 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance destroyed successfully.
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'resources' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.objects.base [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-439136322',display_name='tempest-AttachVolumeTestJSON-server-439136322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-439136322',id=15,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2iGfEXaPgxPn5izpripEi2/XY/bHunM2ZOKB1jTII0azdkSPatKwlT3TbO7EwNnoRFvRzERTAu0AuwvB5cbX4ENLG57+jsj++oymIjEa63YTDE00owdCA8Ukeap2uu+A==',key_name='tempest-keypair-837672835',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-la2mgmq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=bbedc3ec-0f54-4977-8546-41ce4f488641,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG os_vif [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b2e69e1-e9, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af64cbb5-dd8f-446a-ac09-b9894f9d350b) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:13:07 user nova-compute[74482]: INFO os_vif [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9')
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Start _get_guest_xml network_info=[{"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'numa_topology' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.objects.base [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:13:07 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:13:07 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'vcpu_model' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.objects.base [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-439136322',display_name='tempest-AttachVolumeTestJSON-server-439136322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-439136322',id=15,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2iGfEXaPgxPn5izpripEi2/XY/bHunM2ZOKB1jTII0azdkSPatKwlT3TbO7EwNnoRFvRzERTAu0AuwvB5cbX4ENLG57+jsj++oymIjEa63YTDE00owdCA8Ukeap2uu+A==',key_name='tempest-keypair-837672835',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-la2mgmq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=bbedc3ec-0f54-4977-8546-41ce4f488641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'pci_devices' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.objects.base [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:13:07 user nova-compute[74482]:   <uuid>bbedc3ec-0f54-4977-8546-41ce4f488641</uuid>
Oct 23 23:13:07 user nova-compute[74482]:   <name>instance-0000000f</name>
Oct 23 23:13:07 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:13:07 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:13:07 user nova-compute[74482]:   <metadata>
Oct 23 23:13:07 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:13:07 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:13:07 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeTestJSON-server-439136322</nova:name>
Oct 23 23:13:07 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:13:07</nova:creationTime>
Oct 23 23:13:07 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:13:07 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:13:07 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:13:07 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:13:07 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:13:07 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:13:07 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:13:07 user nova-compute[74482]:       <nova:owner>
Oct 23 23:13:07 user nova-compute[74482]:         <nova:user uuid="ba4aeef9339f48d6929e4cfa97af0860">tempest-AttachVolumeTestJSON-1506893999-project-member</nova:user>
Oct 23 23:13:07 user nova-compute[74482]:         <nova:project uuid="5bef228274d9477091fcd021ca8271e3">tempest-AttachVolumeTestJSON-1506893999</nova:project>
Oct 23 23:13:07 user nova-compute[74482]:       </nova:owner>
Oct 23 23:13:07 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:13:07 user nova-compute[74482]:       <nova:ports>
Oct 23 23:13:07 user nova-compute[74482]:         <nova:port uuid="9b2e69e1-e9e5-47ee-a252-cc7e568d4523">
Oct 23 23:13:07 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 23:13:07 user nova-compute[74482]:         </nova:port>
Oct 23 23:13:07 user nova-compute[74482]:       </nova:ports>
Oct 23 23:13:07 user nova-compute[74482]:     </nova:instance>
Oct 23 23:13:07 user nova-compute[74482]:   </metadata>
Oct 23 23:13:07 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:13:07 user nova-compute[74482]:     <system>
Oct 23 23:13:07 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:13:07 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:13:07 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:13:07 user nova-compute[74482]:       <entry name="serial">bbedc3ec-0f54-4977-8546-41ce4f488641</entry>
Oct 23 23:13:07 user nova-compute[74482]:       <entry name="uuid">bbedc3ec-0f54-4977-8546-41ce4f488641</entry>
Oct 23 23:13:07 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:13:07 user nova-compute[74482]:     </system>
Oct 23 23:13:07 user nova-compute[74482]:   </sysinfo>
Oct 23 23:13:07 user nova-compute[74482]:   <os>
Oct 23 23:13:07 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:13:07 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:13:07 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:13:07 user nova-compute[74482]:   </os>
Oct 23 23:13:07 user nova-compute[74482]:   <features>
Oct 23 23:13:07 user nova-compute[74482]:     <acpi/>
Oct 23 23:13:07 user nova-compute[74482]:     <apic/>
Oct 23 23:13:07 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:13:07 user nova-compute[74482]:   </features>
Oct 23 23:13:07 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:13:07 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:13:07 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:13:07 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:13:07 user nova-compute[74482]:   </clock>
Oct 23 23:13:07 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:13:07 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:13:07 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:13:07 user nova-compute[74482]:   </cpu>
Oct 23 23:13:07 user nova-compute[74482]:   <devices>
Oct 23 23:13:07 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:13:07 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:13:07 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk"/>
Oct 23 23:13:07 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:13:07 user nova-compute[74482]:     </disk>
Oct 23 23:13:07 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:13:07 user nova-compute[74482]:       <mac address="fa:16:3e:f4:77:36"/>
Oct 23 23:13:07 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:13:07 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:13:07 user nova-compute[74482]:       <target dev="tap9b2e69e1-e9"/>
Oct 23 23:13:07 user nova-compute[74482]:     </interface>
Oct 23 23:13:07 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:13:07 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/console.log" append="off"/>
Oct 23 23:13:07 user nova-compute[74482]:     </serial>
Oct 23 23:13:07 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:13:07 user nova-compute[74482]:     <video>
Oct 23 23:13:07 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:13:07 user nova-compute[74482]:     </video>
Oct 23 23:13:07 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:13:07 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:13:07 user nova-compute[74482]:     </rng>
Oct 23 23:13:07 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:13:07 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:13:07 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:13:07 user nova-compute[74482]:     </memballoon>
Oct 23 23:13:07 user nova-compute[74482]:   </devices>
Oct 23 23:13:07 user nova-compute[74482]: </domain>
Oct 23 23:13:07 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'trusted_certs' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG nova.objects.base [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Cannot resize image /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'migration_context' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG nova.objects.base [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Object Instance<bbedc3ec-0f54-4977-8546-41ce4f488641> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-439136322',display_name='tempest-AttachVolumeTestJSON-server-439136322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-439136322',id=15,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2iGfEXaPgxPn5izpripEi2/XY/bHunM2ZOKB1jTII0azdkSPatKwlT3TbO7EwNnoRFvRzERTAu0AuwvB5cbX4ENLG57+jsj++oymIjEa63YTDE00owdCA8Ukeap2uu+A==',key_name='tempest-keypair-837672835',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-la2mgmq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=bbedc3ec-0f54-4977-8546-41ce4f488641,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG os_vif [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd01e535d-6286-5015-ae64-9329ce9105df', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b2e69e1-e9, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b2e69e1-e9, col_values=(('qos', UUID('9093721a-8e7f-40f4-bebf-8e11a960217a')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b2e69e1-e9, col_values=(('external_ids', {'iface-id': '9b2e69e1-e9e5-47ee-a252-cc7e568d4523', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:77:36', 'vm-uuid': 'bbedc3ec-0f54-4977-8546-41ce4f488641'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:08 user nova-compute[74482]: INFO os_vif [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9')
Oct 23 23:13:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-4391abdc-0d02-48af-ae96-bd3756b54c49 req-6ff22523-7f9c-4df8-856c-c574554dc4fd service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4391abdc-0d02-48af-ae96-bd3756b54c49 req-6ff22523-7f9c-4df8-856c-c574554dc4fd service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4391abdc-0d02-48af-ae96-bd3756b54c49 req-6ff22523-7f9c-4df8-856c-c574554dc4fd service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4391abdc-0d02-48af-ae96-bd3756b54c49 req-6ff22523-7f9c-4df8-856c-c574554dc4fd service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-4391abdc-0d02-48af-ae96-bd3756b54c49 req-6ff22523-7f9c-4df8-856c-c574554dc4fd service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:13:10 user nova-compute[74482]: WARNING nova.compute.manager [req-4391abdc-0d02-48af-ae96-bd3756b54c49 req-6ff22523-7f9c-4df8-856c-c574554dc4fd service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state stopped and task_state powering-on.
Oct 23 23:13:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-b910a753-f392-41aa-861d-9a8b133caab7 req-434ea39c-1130-4c0d-bed0-92cdefb524ef service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b910a753-f392-41aa-861d-9a8b133caab7 req-434ea39c-1130-4c0d-bed0-92cdefb524ef service nova] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b910a753-f392-41aa-861d-9a8b133caab7 req-434ea39c-1130-4c0d-bed0-92cdefb524ef service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b910a753-f392-41aa-861d-9a8b133caab7 req-434ea39c-1130-4c0d-bed0-92cdefb524ef service nova] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-b910a753-f392-41aa-861d-9a8b133caab7 req-434ea39c-1130-4c0d-bed0-92cdefb524ef service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] No waiting events found dispatching network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:13:12 user nova-compute[74482]: WARNING nova.compute.manager [req-b910a753-f392-41aa-861d-9a8b133caab7 req-434ea39c-1130-4c0d-bed0-92cdefb524ef service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received unexpected event network-vif-plugged-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 for instance with vm_state stopped and task_state powering-on.
Oct 23 23:13:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:13:12 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance rebooted successfully.
Oct 23 23:13:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e9fb039a-89bf-4f24-bbde-ff9ab616c91b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:13:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:13:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:13:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:13:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:25 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:13:25 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7410MB free_disk=24.885517120361328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance a18c958b-f7d9-47ba-ad98-332e12838d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 233cb56f-9cce-4c10-94db-cf694a20af1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 095c2860-554f-4622-902d-8cafda6dbfe9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7b69955-1715-4185-8926-12b46b32227d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:13:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:13:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:13:34 user nova-compute[74482]: INFO nova.compute.claims [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Claim successful on node user
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:13:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.policy [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27c14666f4cf4c7bb290aa64186ae51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692170d5af714ece938c945f271848b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:13:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Creating image(s)
Oct 23 23:13:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "/opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "/opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "/opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk 1073741824" returned: 0 in 0.067s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Successfully created port: b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Cannot resize image /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Ensure instance console log exists: /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Successfully updated port: b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "refresh_cache-102b4a8c-5b4e-4620-825b-2935b0e46728" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquired lock "refresh_cache-102b4a8c-5b4e-4620-825b-2935b0e46728" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-536e234f-a3c0-444b-862e-fe3629ccbb85 req-693249b9-c940-41f1-b7f7-6c8208310bd2 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received event network-changed-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-536e234f-a3c0-444b-862e-fe3629ccbb85 req-693249b9-c940-41f1-b7f7-6c8208310bd2 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Refreshing instance network info cache due to event network-changed-b37dc75d-16ac-40b4-b0e1-36c6625d095a. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-536e234f-a3c0-444b-862e-fe3629ccbb85 req-693249b9-c940-41f1-b7f7-6c8208310bd2 service nova] Acquiring lock "refresh_cache-102b4a8c-5b4e-4620-825b-2935b0e46728" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Updating instance_info_cache with network_info: [{"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Releasing lock "refresh_cache-102b4a8c-5b4e-4620-825b-2935b0e46728" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Instance network_info: |[{"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-536e234f-a3c0-444b-862e-fe3629ccbb85 req-693249b9-c940-41f1-b7f7-6c8208310bd2 service nova] Acquired lock "refresh_cache-102b4a8c-5b4e-4620-825b-2935b0e46728" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.neutron [req-536e234f-a3c0-444b-862e-fe3629ccbb85 req-693249b9-c940-41f1-b7f7-6c8208310bd2 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Refreshing network info cache for port b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Start _get_guest_xml network_info=[{"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:13:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:13:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1248908934',display_name='tempest-DeleteServersTestJSON-server-1248908934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1248908934',id=26,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='692170d5af714ece938c945f271848b0',ramdisk_id='',reservation_id='r-02g5iuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1727172578',owner_user_name='tempest-DeleteServersTestJSON-1727172578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:13:35Z,user_data=None,user_id='27c14666f4cf4c7bb290aa64186ae51d',uuid=102b4a8c-5b4e-4620-825b-2935b0e46728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Converting VIF {"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:90,bridge_name='br-int',has_traffic_filtering=True,id=b37dc75d-16ac-40b4-b0e1-36c6625d095a,network=Network(35da1dd5-78c6-446e-a484-dbcacc570fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb37dc75d-16') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.objects.instance [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lazy-loading 'pci_devices' on Instance uuid 102b4a8c-5b4e-4620-825b-2935b0e46728 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:13:36 user nova-compute[74482]:   <uuid>102b4a8c-5b4e-4620-825b-2935b0e46728</uuid>
Oct 23 23:13:36 user nova-compute[74482]:   <name>instance-0000001a</name>
Oct 23 23:13:36 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:13:36 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:13:36 user nova-compute[74482]:   <metadata>
Oct 23 23:13:36 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:13:36 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:13:36 user nova-compute[74482]:       <nova:name>tempest-DeleteServersTestJSON-server-1248908934</nova:name>
Oct 23 23:13:36 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:13:36</nova:creationTime>
Oct 23 23:13:36 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:13:36 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:13:36 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:13:36 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:13:36 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:13:36 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:13:36 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:13:36 user nova-compute[74482]:       <nova:owner>
Oct 23 23:13:36 user nova-compute[74482]:         <nova:user uuid="27c14666f4cf4c7bb290aa64186ae51d">tempest-DeleteServersTestJSON-1727172578-project-member</nova:user>
Oct 23 23:13:36 user nova-compute[74482]:         <nova:project uuid="692170d5af714ece938c945f271848b0">tempest-DeleteServersTestJSON-1727172578</nova:project>
Oct 23 23:13:36 user nova-compute[74482]:       </nova:owner>
Oct 23 23:13:36 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:13:36 user nova-compute[74482]:       <nova:ports>
Oct 23 23:13:36 user nova-compute[74482]:         <nova:port uuid="b37dc75d-16ac-40b4-b0e1-36c6625d095a">
Oct 23 23:13:36 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 23:13:36 user nova-compute[74482]:         </nova:port>
Oct 23 23:13:36 user nova-compute[74482]:       </nova:ports>
Oct 23 23:13:36 user nova-compute[74482]:     </nova:instance>
Oct 23 23:13:36 user nova-compute[74482]:   </metadata>
Oct 23 23:13:36 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:13:36 user nova-compute[74482]:     <system>
Oct 23 23:13:36 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:13:36 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:13:36 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:13:36 user nova-compute[74482]:       <entry name="serial">102b4a8c-5b4e-4620-825b-2935b0e46728</entry>
Oct 23 23:13:36 user nova-compute[74482]:       <entry name="uuid">102b4a8c-5b4e-4620-825b-2935b0e46728</entry>
Oct 23 23:13:36 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:13:36 user nova-compute[74482]:     </system>
Oct 23 23:13:36 user nova-compute[74482]:   </sysinfo>
Oct 23 23:13:36 user nova-compute[74482]:   <os>
Oct 23 23:13:36 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:13:36 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:13:36 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:13:36 user nova-compute[74482]:   </os>
Oct 23 23:13:36 user nova-compute[74482]:   <features>
Oct 23 23:13:36 user nova-compute[74482]:     <acpi/>
Oct 23 23:13:36 user nova-compute[74482]:     <apic/>
Oct 23 23:13:36 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:13:36 user nova-compute[74482]:   </features>
Oct 23 23:13:36 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:13:36 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:13:36 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:13:36 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:13:36 user nova-compute[74482]:   </clock>
Oct 23 23:13:36 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:13:36 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:13:36 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:13:36 user nova-compute[74482]:   </cpu>
Oct 23 23:13:36 user nova-compute[74482]:   <devices>
Oct 23 23:13:36 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:13:36 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:13:36 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk"/>
Oct 23 23:13:36 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:13:36 user nova-compute[74482]:     </disk>
Oct 23 23:13:36 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:13:36 user nova-compute[74482]:       <mac address="fa:16:3e:db:22:90"/>
Oct 23 23:13:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:13:36 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:13:36 user nova-compute[74482]:       <target dev="tapb37dc75d-16"/>
Oct 23 23:13:36 user nova-compute[74482]:     </interface>
Oct 23 23:13:36 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:13:36 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/console.log" append="off"/>
Oct 23 23:13:36 user nova-compute[74482]:     </serial>
Oct 23 23:13:36 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:13:36 user nova-compute[74482]:     <video>
Oct 23 23:13:36 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:13:36 user nova-compute[74482]:     </video>
Oct 23 23:13:36 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:13:36 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:13:36 user nova-compute[74482]:     </rng>
Oct 23 23:13:36 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:13:36 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:13:36 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:13:36 user nova-compute[74482]:     </memballoon>
Oct 23 23:13:36 user nova-compute[74482]:   </devices>
Oct 23 23:13:36 user nova-compute[74482]: </domain>
Oct 23 23:13:36 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1248908934',display_name='tempest-DeleteServersTestJSON-server-1248908934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1248908934',id=26,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='692170d5af714ece938c945f271848b0',ramdisk_id='',reservation_id='r-02g5iuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1727172578',owner_user_name='tempest-DeleteServersTestJSON-1727172578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:13:35Z,user_data=None,user_id='27c14666f4cf4c7bb290aa64186ae51d',uuid=102b4a8c-5b4e-4620-825b-2935b0e46728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Converting VIF {"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:90,bridge_name='br-int',has_traffic_filtering=True,id=b37dc75d-16ac-40b4-b0e1-36c6625d095a,network=Network(35da1dd5-78c6-446e-a484-dbcacc570fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb37dc75d-16') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG os_vif [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:90,bridge_name='br-int',has_traffic_filtering=True,id=b37dc75d-16ac-40b4-b0e1-36c6625d095a,network=Network(35da1dd5-78c6-446e-a484-dbcacc570fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb37dc75d-16') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96922878-f0a6-596b-898b-d04b6b2d4463', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb37dc75d-16, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb37dc75d-16, col_values=(('qos', UUID('d59b8f79-3c3e-41be-bcd2-3dac7b622001')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb37dc75d-16, col_values=(('external_ids', {'iface-id': 'b37dc75d-16ac-40b4-b0e1-36c6625d095a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:22:90', 'vm-uuid': '102b4a8c-5b4e-4620-825b-2935b0e46728'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:36 user nova-compute[74482]: INFO os_vif [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:90,bridge_name='br-int',has_traffic_filtering=True,id=b37dc75d-16ac-40b4-b0e1-36c6625d095a,network=Network(35da1dd5-78c6-446e-a484-dbcacc570fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb37dc75d-16')
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] No VIF found with MAC fa:16:3e:db:22:90, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.neutron [req-536e234f-a3c0-444b-862e-fe3629ccbb85 req-693249b9-c940-41f1-b7f7-6c8208310bd2 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Updated VIF entry in instance network info cache for port b37dc75d-16ac-40b4-b0e1-36c6625d095a. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG nova.network.neutron [req-536e234f-a3c0-444b-862e-fe3629ccbb85 req-693249b9-c940-41f1-b7f7-6c8208310bd2 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Updating instance_info_cache with network_info: [{"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:13:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-536e234f-a3c0-444b-862e-fe3629ccbb85 req-693249b9-c940-41f1-b7f7-6c8208310bd2 service nova] Releasing lock "refresh_cache-102b4a8c-5b4e-4620-825b-2935b0e46728" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-312e6dd4-9193-40f1-a5fb-7b705a1462d5 req-278fb376-2487-440c-92d6-9abe27f77b95 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received event network-vif-plugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-312e6dd4-9193-40f1-a5fb-7b705a1462d5 req-278fb376-2487-440c-92d6-9abe27f77b95 service nova] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-312e6dd4-9193-40f1-a5fb-7b705a1462d5 req-278fb376-2487-440c-92d6-9abe27f77b95 service nova] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-312e6dd4-9193-40f1-a5fb-7b705a1462d5 req-278fb376-2487-440c-92d6-9abe27f77b95 service nova] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-312e6dd4-9193-40f1-a5fb-7b705a1462d5 req-278fb376-2487-440c-92d6-9abe27f77b95 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] No waiting events found dispatching network-vif-plugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:13:38 user nova-compute[74482]: WARNING nova.compute.manager [req-312e6dd4-9193-40f1-a5fb-7b705a1462d5 req-278fb376-2487-440c-92d6-9abe27f77b95 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received unexpected event network-vif-plugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a for instance with vm_state building and task_state spawning.
Oct 23 23:13:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-9a0456e2-d988-4285-97d0-084eb6799309 req-4184850a-23d3-4241-b6a6-e2e0d96f4ab2 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received event network-vif-plugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9a0456e2-d988-4285-97d0-084eb6799309 req-4184850a-23d3-4241-b6a6-e2e0d96f4ab2 service nova] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9a0456e2-d988-4285-97d0-084eb6799309 req-4184850a-23d3-4241-b6a6-e2e0d96f4ab2 service nova] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9a0456e2-d988-4285-97d0-084eb6799309 req-4184850a-23d3-4241-b6a6-e2e0d96f4ab2 service nova] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-9a0456e2-d988-4285-97d0-084eb6799309 req-4184850a-23d3-4241-b6a6-e2e0d96f4ab2 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] No waiting events found dispatching network-vif-plugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:13:40 user nova-compute[74482]: WARNING nova.compute.manager [req-9a0456e2-d988-4285-97d0-084eb6799309 req-4184850a-23d3-4241-b6a6-e2e0d96f4ab2 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received unexpected event network-vif-plugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a for instance with vm_state building and task_state spawning.
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:13:40 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Instance spawned successfully.
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:13:40 user nova-compute[74482]: INFO nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Took 5.88 seconds to spawn the instance on the hypervisor.
Oct 23 23:13:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:13:40 user nova-compute[74482]: INFO nova.compute.manager [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Took 6.77 seconds to build instance.
Oct 23 23:13:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-795e843a-7160-49f4-a620-1dd72923bd01 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.902s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-768eeef0-1f1a-47ce-9834-9d295317e2f2 req-1a4cc78a-d680-4766-be63-38bf509ae111 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received event network-changed-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-768eeef0-1f1a-47ce-9834-9d295317e2f2 req-1a4cc78a-d680-4766-be63-38bf509ae111 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Refreshing instance network info cache due to event network-changed-c4bb13fd-216f-4510-91df-11b772b3b71e. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:13:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-768eeef0-1f1a-47ce-9834-9d295317e2f2 req-1a4cc78a-d680-4766-be63-38bf509ae111 service nova] Acquiring lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:13:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-768eeef0-1f1a-47ce-9834-9d295317e2f2 req-1a4cc78a-d680-4766-be63-38bf509ae111 service nova] Acquired lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:13:50 user nova-compute[74482]: DEBUG nova.network.neutron [req-768eeef0-1f1a-47ce-9834-9d295317e2f2 req-1a4cc78a-d680-4766-be63-38bf509ae111 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Refreshing network info cache for port c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:13:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-768eeef0-1f1a-47ce-9834-9d295317e2f2 req-1a4cc78a-d680-4766-be63-38bf509ae111 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updated VIF entry in instance network info cache for port c4bb13fd-216f-4510-91df-11b772b3b71e. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:13:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-768eeef0-1f1a-47ce-9834-9d295317e2f2 req-1a4cc78a-d680-4766-be63-38bf509ae111 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updating instance_info_cache with network_info: [{"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:13:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-768eeef0-1f1a-47ce-9834-9d295317e2f2 req-1a4cc78a-d680-4766-be63-38bf509ae111 service nova] Releasing lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:13:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-41042467-6760-4a3f-890f-9dc19119ccd4 req-bdb2f77d-a63e-4786-abf3-1447e02b697f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-changed-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-41042467-6760-4a3f-890f-9dc19119ccd4 req-bdb2f77d-a63e-4786-abf3-1447e02b697f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Refreshing instance network info cache due to event network-changed-ff82f9a6-5f42-4e98-b4df-93bbfb502665. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-41042467-6760-4a3f-890f-9dc19119ccd4 req-bdb2f77d-a63e-4786-abf3-1447e02b697f service nova] Acquiring lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-41042467-6760-4a3f-890f-9dc19119ccd4 req-bdb2f77d-a63e-4786-abf3-1447e02b697f service nova] Acquired lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:13:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-41042467-6760-4a3f-890f-9dc19119ccd4 req-bdb2f77d-a63e-4786-abf3-1447e02b697f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Refreshing network info cache for port ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:13:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Stashing vm_state: active {{(pid=74482) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 23 23:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:13:52 user nova-compute[74482]: INFO nova.compute.claims [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Claim successful on node user
Oct 23 23:13:52 user nova-compute[74482]: INFO nova.compute.resource_tracker [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating resource usage from migration 11c6e85e-fff3-49d1-9ca8-bb004c1d777a
Oct 23 23:13:53 user nova-compute[74482]: DEBUG nova.network.neutron [req-41042467-6760-4a3f-890f-9dc19119ccd4 req-bdb2f77d-a63e-4786-abf3-1447e02b697f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updated VIF entry in instance network info cache for port ff82f9a6-5f42-4e98-b4df-93bbfb502665. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:13:53 user nova-compute[74482]: DEBUG nova.network.neutron [req-41042467-6760-4a3f-890f-9dc19119ccd4 req-bdb2f77d-a63e-4786-abf3-1447e02b697f service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating instance_info_cache with network_info: [{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-41042467-6760-4a3f-890f-9dc19119ccd4 req-bdb2f77d-a63e-4786-abf3-1447e02b697f service nova] Releasing lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:13:53 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:13:53 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.566s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:53 user nova-compute[74482]: INFO nova.compute.manager [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Migrating
Oct 23 23:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquired lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:13:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:13:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating instance_info_cache with network_info: [{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Releasing lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Starting migrate_disk_and_power_off {{(pid=74482) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-9868ac8c-b15c-4233-8f26-db5fc739034b req-274eb652-9907-41b3-bc7f-d50cbbccef12 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-unplugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9868ac8c-b15c-4233-8f26-db5fc739034b req-274eb652-9907-41b3-bc7f-d50cbbccef12 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9868ac8c-b15c-4233-8f26-db5fc739034b req-274eb652-9907-41b3-bc7f-d50cbbccef12 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9868ac8c-b15c-4233-8f26-db5fc739034b req-274eb652-9907-41b3-bc7f-d50cbbccef12 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-9868ac8c-b15c-4233-8f26-db5fc739034b req-274eb652-9907-41b3-bc7f-d50cbbccef12 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-unplugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:13:54 user nova-compute[74482]: WARNING nova.compute.manager [req-9868ac8c-b15c-4233-8f26-db5fc739034b req-274eb652-9907-41b3-bc7f-d50cbbccef12 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-unplugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state active and task_state resize_migrating.
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:54 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: c7b69955-1715-4185-8926-12b46b32227d] Instance destroyed successfully.
Oct 23 23:13:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1502585542',display_name='tempest-ServerActionsTestOtherA-server-1502585542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1502585542',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIFqjOSyUZWQsU5gFsbXrBOoj4Cp26qpoZb6ZuADPp+mJaMBG92ILD46Qtgf0LpXdVLgOqmH/QEGrVpFM/l9sAP2h6k2MXu+chElwiN2sa7paHBVT+RCfDr3O/3kW7sqg==',key_name='tempest-keypair-1686845388',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:12:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-8rr9kvp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:13:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=c7b69955-1715-4185-8926-12b46b32227d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-632985130-network", "vif_mac": "fa:16:3e:96:ad:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-632985130-network", "vif_mac": "fa:16:3e:96:ad:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_vif [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff82f9a6-5f, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a58d10d4-0116-4b84-ae0a-49cbdaea4a23) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:13:54 user nova-compute[74482]: INFO os_vif [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f')
Oct 23 23:13:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikLSfjBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:13:54 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd9000-c9e3-4f61-a90c-42db59a487f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:13:54 user nova-compute[74482]: No targets found.
Oct 23 23:13:54 user nova-compute[74482]: iSNS:
Oct 23 23:13:54 user nova-compute[74482]: No targets found.
Oct 23 23:13:54 user nova-compute[74482]: STATIC:
Oct 23 23:13:54 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a
Oct 23 23:13:54 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:13:54 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:13:54 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25
Oct 23 23:13:54 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:13:54 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:13:54 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:13:54 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:13:54 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:13:54 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18
Oct 23 23:13:54 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:13:54 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:13:54 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe
Oct 23 23:13:54 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:13:54 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:13:54 user nova-compute[74482]: FIRMWARE:
Oct 23 23:13:54 user nova-compute[74482]: No targets found.
Oct 23 23:13:54 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:13:54 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:13:54 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[678c5104-adec-4b4f-a90b-ffbb645c9afb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff51fbd-7e56-4f4d-9eda-f88b67f26ad3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:13:54 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:13:54 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:13:54 user nova-compute[74482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:13:54 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:13:54 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:13:54 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:13:54 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:13:54 user nova-compute[74482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:13:54 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:13:54 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c4aacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe'): ({'sdf'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Removing single pathed devices sdf {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b2d5c-3ca7-4905-93d8-36cf8d431156]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a83cb2-80b9-470e-85b0-2c8b00a80090]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flushing IO for device /dev/sdf {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7069ca67-b9be-483c-8fb0-aa1e6369b517]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[783a7f7f-a7d6-4a1c-8a29-5c70f6f252ae]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_14a32821', '/dev/disk/by-id/scsi-1SCST_BIO14a32821-84190084870da926', '/dev/disk/by-id/scsi-23834313930303834') {{(pid=86306) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5a51ad-9e44-4276-bdf9-7295a18e6b7d]: (4, None) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9c049f-10fd-4f73-9ccb-21aa06041d25]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-d7a27d94-37a3-421a-8577-60125a4efb16 req-8121dd35-5332-4435-a251-f02ebee23086 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-changed-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-d7a27d94-37a3-421a-8577-60125a4efb16 req-8121dd35-5332-4435-a251-f02ebee23086 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Refreshing instance network info cache due to event network-changed-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d7a27d94-37a3-421a-8577-60125a4efb16 req-8121dd35-5332-4435-a251-f02ebee23086 service nova] Acquiring lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d7a27d94-37a3-421a-8577-60125a4efb16 req-8121dd35-5332-4435-a251-f02ebee23086 service nova] Acquired lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-d7a27d94-37a3-421a-8577-60125a4efb16 req-8121dd35-5332-4435-a251-f02ebee23086 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Refreshing network info cache for port e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc497d7-1c0e-4815-9d00-fe50a5232ba9]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260]
Oct 23 23:13:55 user nova-compute[74482]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260] successful.
Oct 23 23:13:55 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2725f1e-7511-47cd-a596-33664ef6af40]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== disconnect_volume: return (398ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-d7a27d94-37a3-421a-8577-60125a4efb16 req-8121dd35-5332-4435-a251-f02ebee23086 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updated VIF entry in instance network info cache for port e28ce78b-2583-4ef4-a071-d3b25fc5a3ea. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-d7a27d94-37a3-421a-8577-60125a4efb16 req-8121dd35-5332-4435-a251-f02ebee23086 service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updating instance_info_cache with network_info: [{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d7a27d94-37a3-421a-8577-60125a4efb16 req-8121dd35-5332-4435-a251-f02ebee23086 service nova] Releasing lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:13:55 user nova-compute[74482]: INFO nova.compute.manager [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Detaching volume 96d06894-5c49-4ccb-a339-fd1fd5eb9a3a
Oct 23 23:13:55 user nova-compute[74482]: INFO nova.virt.block_device [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Attempting to driver detach volume 96d06894-5c49-4ccb-a339-fd1fd5eb9a3a from mountpoint /dev/vdb
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Attempting to detach device vdb from instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:13:55 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:13:55 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:13:55 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:13:55 user nova-compute[74482]:   <serial>96d06894-5c49-4ccb-a339-fd1fd5eb9a3a</serial>
Oct 23 23:13:55 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:13:55 user nova-compute[74482]: </disk>
Oct 23 23:13:55 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:13:55 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Successfully detached device vdb from instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b from the persistent domain config.
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:13:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:13:55 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:13:55 user nova-compute[74482]:   <source dev="/dev/sdd"/>
Oct 23 23:13:55 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:13:55 user nova-compute[74482]:   <serial>96d06894-5c49-4ccb-a339-fd1fd5eb9a3a</serial>
Oct 23 23:13:55 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:13:55 user nova-compute[74482]: </disk>
Oct 23 23:13:55 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-2ceb1d9c-c247-4914-ac01-156d2ee24f60 req-4695a8aa-e8d0-4a2b-9edc-10ee9646d9f4 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2ceb1d9c-c247-4914-ac01-156d2ee24f60 req-4695a8aa-e8d0-4a2b-9edc-10ee9646d9f4 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2ceb1d9c-c247-4914-ac01-156d2ee24f60 req-4695a8aa-e8d0-4a2b-9edc-10ee9646d9f4 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2ceb1d9c-c247-4914-ac01-156d2ee24f60 req-4695a8aa-e8d0-4a2b-9edc-10ee9646d9f4 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-2ceb1d9c-c247-4914-ac01-156d2ee24f60 req-4695a8aa-e8d0-4a2b-9edc-10ee9646d9f4 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:13:56 user nova-compute[74482]: WARNING nova.compute.manager [req-2ceb1d9c-c247-4914-ac01-156d2ee24f60 req-4695a8aa-e8d0-4a2b-9edc-10ee9646d9f4 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state active and task_state resize_migrating.
Oct 23 23:13:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Port ff82f9a6-5f42-4e98-b4df-93bbfb502665 binding to destination host user is already ACTIVE {{(pid=74482) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquired lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:13:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating instance_info_cache with network_info: [{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-1d747eeb-ea15-4d57-84dc-6284cf4c58bb req-106df053-1d4d-4048-acba-ed0ffbf85d8b service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-changed-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-1d747eeb-ea15-4d57-84dc-6284cf4c58bb req-106df053-1d4d-4048-acba-ed0ffbf85d8b service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Refreshing instance network info cache due to event network-changed-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1d747eeb-ea15-4d57-84dc-6284cf4c58bb req-106df053-1d4d-4048-acba-ed0ffbf85d8b service nova] Acquiring lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1d747eeb-ea15-4d57-84dc-6284cf4c58bb req-106df053-1d4d-4048-acba-ed0ffbf85d8b service nova] Acquired lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-1d747eeb-ea15-4d57-84dc-6284cf4c58bb req-106df053-1d4d-4048-acba-ed0ffbf85d8b service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Refreshing network info cache for port e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Releasing lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG os_brick.utils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0d14e5-f4a4-4e9c-9bf7-676b76e7bf77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aea24ee-d4d2-4f04-b6f9-2124e1ee7995]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d00e1cf-fd81-4a74-a865-367fb1b0c405]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef94fa6-60f4-4eee-af19-8706ee23eca1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:13:57 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:13:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[91762d12-60da-47c9-8b29-7a0640eacb4a]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG os_brick.utils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-1d747eeb-ea15-4d57-84dc-6284cf4c58bb req-106df053-1d4d-4048-acba-ed0ffbf85d8b service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updated VIF entry in instance network info cache for port e28ce78b-2583-4ef4-a071-d3b25fc5a3ea. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:13:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-1d747eeb-ea15-4d57-84dc-6284cf4c58bb req-106df053-1d4d-4048-acba-ed0ffbf85d8b service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updating instance_info_cache with network_info: [{"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:13:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1d747eeb-ea15-4d57-84dc-6284cf4c58bb req-106df053-1d4d-4048-acba-ed0ffbf85d8b service nova] Releasing lock "refresh_cache-03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:13:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:13:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-0c32d85e-6706-4a6b-b548-bc272a22182b req-1487d1fc-0fbd-4dbd-a838-82b8052359a6 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-0c32d85e-6706-4a6b-b548-bc272a22182b req-1487d1fc-0fbd-4dbd-a838-82b8052359a6 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing instance network info cache due to event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:14:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0c32d85e-6706-4a6b-b548-bc272a22182b req-1487d1fc-0fbd-4dbd-a838-82b8052359a6 service nova] Acquiring lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:14:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0c32d85e-6706-4a6b-b548-bc272a22182b req-1487d1fc-0fbd-4dbd-a838-82b8052359a6 service nova] Acquired lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:14:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-0c32d85e-6706-4a6b-b548-bc272a22182b req-1487d1fc-0fbd-4dbd-a838-82b8052359a6 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:14:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-0c32d85e-6706-4a6b-b548-bc272a22182b req-1487d1fc-0fbd-4dbd-a838-82b8052359a6 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updated VIF entry in instance network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:14:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-0c32d85e-6706-4a6b-b548-bc272a22182b req-1487d1fc-0fbd-4dbd-a838-82b8052359a6 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updating instance_info_cache with network_info: [{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:14:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0c32d85e-6706-4a6b-b548-bc272a22182b req-1487d1fc-0fbd-4dbd-a838-82b8052359a6 service nova] Releasing lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-8347929a-beba-4208-a1f0-4e8c2587cce5 req-ff80ae37-7976-44be-a891-4ff771ab6c4b service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-8347929a-beba-4208-a1f0-4e8c2587cce5 req-ff80ae37-7976-44be-a891-4ff771ab6c4b service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing instance network info cache due to event network-changed-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8347929a-beba-4208-a1f0-4e8c2587cce5 req-ff80ae37-7976-44be-a891-4ff771ab6c4b service nova] Acquiring lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8347929a-beba-4208-a1f0-4e8c2587cce5 req-ff80ae37-7976-44be-a891-4ff771ab6c4b service nova] Acquired lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG nova.network.neutron [req-8347929a-beba-4208-a1f0-4e8c2587cce5 req-ff80ae37-7976-44be-a891-4ff771ab6c4b service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Refreshing network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:03 user nova-compute[74482]: INFO nova.compute.manager [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Detaching volume 99cdd5d3-493b-47e7-a698-83647110de25
Oct 23 23:14:03 user nova-compute[74482]: INFO nova.virt.block_device [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Attempting to driver detach volume 99cdd5d3-493b-47e7-a698-83647110de25 from mountpoint /dev/vdb
Oct 23 23:14:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Attempting to detach device vdb from instance 233cb56f-9cce-4c10-94db-cf694a20af1f from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:14:03 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:14:03 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:14:03 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:14:03 user nova-compute[74482]:   <serial>99cdd5d3-493b-47e7-a698-83647110de25</serial>
Oct 23 23:14:03 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 23:14:03 user nova-compute[74482]: </disk>
Oct 23 23:14:03 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:14:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully detached device vdb from instance 233cb56f-9cce-4c10-94db-cf694a20af1f from the persistent domain config.
Oct 23 23:14:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 233cb56f-9cce-4c10-94db-cf694a20af1f from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:14:03 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:14:03 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:14:03 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:14:03 user nova-compute[74482]:   <serial>99cdd5d3-493b-47e7-a698-83647110de25</serial>
Oct 23 23:14:03 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 23:14:03 user nova-compute[74482]: </disk>
Oct 23 23:14:03 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG nova.network.neutron [req-8347929a-beba-4208-a1f0-4e8c2587cce5 req-ff80ae37-7976-44be-a891-4ff771ab6c4b service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updated VIF entry in instance network info cache for port fb4eca63-002e-4eaf-b6ef-f2d6f558f20a. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG nova.network.neutron [req-8347929a-beba-4208-a1f0-4e8c2587cce5 req-ff80ae37-7976-44be-a891-4ff771ab6c4b service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updating instance_info_cache with network_info: [{"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8347929a-beba-4208-a1f0-4e8c2587cce5 req-ff80ae37-7976-44be-a891-4ff771ab6c4b service nova] Releasing lock "refresh_cache-233cb56f-9cce-4c10-94db-cf694a20af1f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:14:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:14:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:14:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:14:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:14:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:14:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:14:10 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:14:10 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid fc2566c6-8911-425b-b05d-a008e67a9d34 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:14:11 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updating instance_info_cache with network_info: [{"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:14:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-fc2566c6-8911-425b-b05d-a008e67a9d34" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:14:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:14:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:14:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:14:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:14:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:16 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b is timed out.
Oct 23 23:14:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Successfully detached device vdb from instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b from the live domain config.
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtsvyumU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:14:16 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6594eb2-52f5-4e07-af44-9ca8a343cc04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:14:16 user nova-compute[74482]: No targets found.
Oct 23 23:14:16 user nova-compute[74482]: iSNS:
Oct 23 23:14:16 user nova-compute[74482]: No targets found.
Oct 23 23:14:16 user nova-compute[74482]: STATIC:
Oct 23 23:14:16 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a
Oct 23 23:14:16 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:14:16 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:14:16 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25
Oct 23 23:14:16 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:14:16 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:14:16 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:14:16 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:14:16 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:14:16 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18
Oct 23 23:14:16 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:14:16 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:14:16 user nova-compute[74482]: FIRMWARE:
Oct 23 23:14:16 user nova-compute[74482]: No targets found.
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:14:16 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:14:16 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde294b9-dd39-409a-b9bc-0204aa92e780]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f95f7e4-8f34-439d-8de7-fbebd77ce3fa]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c437d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a'): ({'sdd'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Removing single pathed devices sdd {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[04559ab9-c61b-44ec-8bd2-1d3ec3a74004]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[530fec09-327e-4b4d-8176-c230305556f1]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Flushing IO for device /dev/sdd {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0961a69-242f-42ff-adb8-40d5ba7ea41b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab9ed1b-691b-4302-8a26-cae9a5b1768c]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b706f9bf-5774-4e6e-bcdc-5cd44a1d8a4b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Starting finish_migration {{(pid=74482) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Instance directory exists: not creating {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 23:14:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Creating image(s)
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Ensure instance console log exists: /opt/stack/data/nova/instances/c7b69955-1715-4185-8926-12b46b32227d/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Start _get_guest_xml network_info=[{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-632985130-network", "vif_mac": "fa:16:3e:96:ad:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikLSfjBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c7b69955-1715-4185-8926-12b46b32227d', 'attached_at': '2023-10-23T23:14:16.000000', 'detached_at': '', 'volume_id': 'bc22b3b7-f89b-4f40-9210-727055244fbe', 'serial': 'bc22b3b7-f89b-4f40-9210-727055244fbe'}, 'disk_bus': 'virtio', 'attachment_id': '28abde04-2716-4da1-8d7b-bc625c8b93ac', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:14:16 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:14:16 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikLSfjBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:14:16 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eeb036-36f7-4e43-9fc6-3862ea021ab6]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a, portal: 172.16.0.220,3260]
Oct 23 23:14:16 user nova-compute[74482]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a, portal: 172.16.0.220,3260] successful.
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d06894-5c49-4ccb-a339-fd1fd5eb9a3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f888ee06-9120-4cde-bcbb-3b25ab02400b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] <== disconnect_volume: return (381ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.041s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:14:16 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:14:16 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3400709-11d5-4d0f-b28a-6c5672b843db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:14:16 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8387613b-d8e1-4171-af6e-9aa79ee7e2e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe] added
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec85d3b-7d9d-4486-bdd9-53f6837f91b1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1c0df6-ab1e-46c1-80b2-1465c5d3f5f7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikLSfjBs {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikLSfjBs" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a8dc86-5f3e-4ff2-89a4-3de082100111]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikLSfjBs'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1527ffca-84a6-41f5-ba56-0829e86da598]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[293ad1a9-80ba-4876-acc2-57c19ff68fc1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cd1d43-7caf-4f26-8d2a-c55c0764c582]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260]
Oct 23 23:14:16 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260] successful.
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83c2e5f-4336-410b-8602-f6af1cfdc18e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[458224ae-c6a0-4265-b8e2-22ac3f1dffc2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:14:16 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:14:16 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf9a458-53e6-45c2-b1ac-f335802dc451]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:14:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikLSfjBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG nova.objects.instance [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'flavor' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cd5d9c2b-7f38-43c4-b419-4ed8c508ba6a tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.840s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23834313930303834', 'path': '/dev/sdd'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834313930303834', 'path': '/dev/sdd'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1502585542',display_name='tempest-ServerActionsTestOtherA-server-1502585542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1502585542',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIFqjOSyUZWQsU5gFsbXrBOoj4Cp26qpoZb6ZuADPp+mJaMBG92ILD46Qtgf0LpXdVLgOqmH/QEGrVpFM/l9sAP2h6k2MXu+chElwiN2sa7paHBVT+RCfDr3O/3kW7sqg==',key_name='tempest-keypair-1686845388',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:12:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-8rr9kvp1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=c7b69955-1715-4185-8926-12b46b32227d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-632985130-network", "vif_mac": "fa:16:3e:96:ad:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-632985130-network", "vif_mac": "fa:16:3e:96:ad:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:14:17 user nova-compute[74482]:   <uuid>c7b69955-1715-4185-8926-12b46b32227d</uuid>
Oct 23 23:14:17 user nova-compute[74482]:   <name>instance-00000019</name>
Oct 23 23:14:17 user nova-compute[74482]:   <memory>2097152</memory>
Oct 23 23:14:17 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:14:17 user nova-compute[74482]:   <metadata>
Oct 23 23:14:17 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:14:17 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:14:17 user nova-compute[74482]:       <nova:name>tempest-ServerActionsTestOtherA-server-1502585542</nova:name>
Oct 23 23:14:17 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:14:16</nova:creationTime>
Oct 23 23:14:17 user nova-compute[74482]:       <nova:flavor name="m1.small">
Oct 23 23:14:17 user nova-compute[74482]:         <nova:memory>2048</nova:memory>
Oct 23 23:14:17 user nova-compute[74482]:         <nova:disk>20</nova:disk>
Oct 23 23:14:17 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:14:17 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:14:17 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:14:17 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:14:17 user nova-compute[74482]:       <nova:owner>
Oct 23 23:14:17 user nova-compute[74482]:         <nova:user uuid="a6e62933fe47479baf3029e44d3b8759">tempest-ServerActionsTestOtherA-1928343369-project-member</nova:user>
Oct 23 23:14:17 user nova-compute[74482]:         <nova:project uuid="7418b41ef984478daf12ce3a2c72c3c6">tempest-ServerActionsTestOtherA-1928343369</nova:project>
Oct 23 23:14:17 user nova-compute[74482]:       </nova:owner>
Oct 23 23:14:17 user nova-compute[74482]:       <nova:ports>
Oct 23 23:14:17 user nova-compute[74482]:         <nova:port uuid="ff82f9a6-5f42-4e98-b4df-93bbfb502665">
Oct 23 23:14:17 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 23:14:17 user nova-compute[74482]:         </nova:port>
Oct 23 23:14:17 user nova-compute[74482]:       </nova:ports>
Oct 23 23:14:17 user nova-compute[74482]:     </nova:instance>
Oct 23 23:14:17 user nova-compute[74482]:   </metadata>
Oct 23 23:14:17 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:14:17 user nova-compute[74482]:     <system>
Oct 23 23:14:17 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:14:17 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:14:17 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:14:17 user nova-compute[74482]:       <entry name="serial">c7b69955-1715-4185-8926-12b46b32227d</entry>
Oct 23 23:14:17 user nova-compute[74482]:       <entry name="uuid">c7b69955-1715-4185-8926-12b46b32227d</entry>
Oct 23 23:14:17 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:14:17 user nova-compute[74482]:     </system>
Oct 23 23:14:17 user nova-compute[74482]:   </sysinfo>
Oct 23 23:14:17 user nova-compute[74482]:   <os>
Oct 23 23:14:17 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:14:17 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:14:17 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:14:17 user nova-compute[74482]:   </os>
Oct 23 23:14:17 user nova-compute[74482]:   <features>
Oct 23 23:14:17 user nova-compute[74482]:     <acpi/>
Oct 23 23:14:17 user nova-compute[74482]:     <apic/>
Oct 23 23:14:17 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:14:17 user nova-compute[74482]:   </features>
Oct 23 23:14:17 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:14:17 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:14:17 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:14:17 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:14:17 user nova-compute[74482]:   </clock>
Oct 23 23:14:17 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:14:17 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:14:17 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:14:17 user nova-compute[74482]:   </cpu>
Oct 23 23:14:17 user nova-compute[74482]:   <devices>
Oct 23 23:14:17 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:14:17 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:14:17 user nova-compute[74482]:       <source dev="/dev/sdd"/>
Oct 23 23:14:17 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:14:17 user nova-compute[74482]:       <serial>bc22b3b7-f89b-4f40-9210-727055244fbe</serial>
Oct 23 23:14:17 user nova-compute[74482]:     </disk>
Oct 23 23:14:17 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:14:17 user nova-compute[74482]:       <mac address="fa:16:3e:96:ad:04"/>
Oct 23 23:14:17 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:14:17 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:14:17 user nova-compute[74482]:       <target dev="tapff82f9a6-5f"/>
Oct 23 23:14:17 user nova-compute[74482]:     </interface>
Oct 23 23:14:17 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:14:17 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/c7b69955-1715-4185-8926-12b46b32227d/console.log" append="off"/>
Oct 23 23:14:17 user nova-compute[74482]:     </serial>
Oct 23 23:14:17 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:14:17 user nova-compute[74482]:     <video>
Oct 23 23:14:17 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:14:17 user nova-compute[74482]:     </video>
Oct 23 23:14:17 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:14:17 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:14:17 user nova-compute[74482]:     </rng>
Oct 23 23:14:17 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:14:17 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:14:17 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:14:17 user nova-compute[74482]:     </memballoon>
Oct 23 23:14:17 user nova-compute[74482]:   </devices>
Oct 23 23:14:17 user nova-compute[74482]: </domain>
Oct 23 23:14:17 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1502585542',display_name='tempest-ServerActionsTestOtherA-server-1502585542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1502585542',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIFqjOSyUZWQsU5gFsbXrBOoj4Cp26qpoZb6ZuADPp+mJaMBG92ILD46Qtgf0LpXdVLgOqmH/QEGrVpFM/l9sAP2h6k2MXu+chElwiN2sa7paHBVT+RCfDr3O/3kW7sqg==',key_name='tempest-keypair-1686845388',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:12:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-8rr9kvp1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=c7b69955-1715-4185-8926-12b46b32227d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-632985130-network", "vif_mac": "fa:16:3e:96:ad:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-632985130-network", "vif_mac": "fa:16:3e:96:ad:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG os_vif [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '261c0de8-27f6-571f-8d22-168f1994f15b', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff82f9a6-5f, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff82f9a6-5f, col_values=(('qos', UUID('7c649cb8-d610-4bfa-a0bc-ead806fe7d12')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff82f9a6-5f, col_values=(('external_ids', {'iface-id': 'ff82f9a6-5f42-4e98-b4df-93bbfb502665', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:ad:04', 'vm-uuid': 'c7b69955-1715-4185-8926-12b46b32227d'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:14:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:14:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:18 user nova-compute[74482]: INFO os_vif [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f')
Oct 23 23:14:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:14:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] No VIF found with MAC fa:16:3e:96:ad:04, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:14:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:14:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:14:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:14:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:14:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:19 user nova-compute[74482]: DEBUG nova.compute.manager [req-eb3e7510-834a-46ad-84e2-a24ba952d735 req-bd8d9483-25de-426d-ac43-e0533b1d8f89 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eb3e7510-834a-46ad-84e2-a24ba952d735 req-bd8d9483-25de-426d-ac43-e0533b1d8f89 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eb3e7510-834a-46ad-84e2-a24ba952d735 req-bd8d9483-25de-426d-ac43-e0533b1d8f89 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-eb3e7510-834a-46ad-84e2-a24ba952d735 req-bd8d9483-25de-426d-ac43-e0533b1d8f89 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:19 user nova-compute[74482]: DEBUG nova.compute.manager [req-eb3e7510-834a-46ad-84e2-a24ba952d735 req-bd8d9483-25de-426d-ac43-e0533b1d8f89 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:14:19 user nova-compute[74482]: WARNING nova.compute.manager [req-eb3e7510-834a-46ad-84e2-a24ba952d735 req-bd8d9483-25de-426d-ac43-e0533b1d8f89 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state active and task_state resize_finish.
Oct 23 23:14:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:14:21 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: c7b69955-1715-4185-8926-12b46b32227d] Instance running successfully.
Oct 23 23:14:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Failed to set time: agent not configured {{(pid=74482) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 23 23:14:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ed20bc29-d28c-49a1-ac72-69342f5ccabd tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] finish_migration finished successfully. {{(pid=74482) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 23 23:14:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-8a727ddd-ab0c-464b-b06b-2e706943def3 req-604beb42-b353-4e10-b24c-4730c9cc1905 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8a727ddd-ab0c-464b-b06b-2e706943def3 req-604beb42-b353-4e10-b24c-4730c9cc1905 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8a727ddd-ab0c-464b-b06b-2e706943def3 req-604beb42-b353-4e10-b24c-4730c9cc1905 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8a727ddd-ab0c-464b-b06b-2e706943def3 req-604beb42-b353-4e10-b24c-4730c9cc1905 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-8a727ddd-ab0c-464b-b06b-2e706943def3 req-604beb42-b353-4e10-b24c-4730c9cc1905 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:14:21 user nova-compute[74482]: WARNING nova.compute.manager [req-8a727ddd-ab0c-464b-b06b-2e706943def3 req-604beb42-b353-4e10-b24c-4730c9cc1905 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state active and task_state resize_finish.
Oct 23 23:14:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:14:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:14:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:22 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:14:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 233cb56f-9cce-4c10-94db-cf694a20af1f is timed out.
Oct 23 23:14:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully detached device vdb from instance 233cb56f-9cce-4c10-94db-cf694a20af1f from the live domain config.
Oct 23 23:14:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UGEpHjuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:14:24 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e251c271-31af-4c00-a445-828e99fdef99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:14:24 user nova-compute[74482]: No targets found.
Oct 23 23:14:24 user nova-compute[74482]: iSNS:
Oct 23 23:14:24 user nova-compute[74482]: No targets found.
Oct 23 23:14:24 user nova-compute[74482]: STATIC:
Oct 23 23:14:24 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25
Oct 23 23:14:24 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:14:24 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:14:24 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:14:24 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:14:24 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:14:24 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18
Oct 23 23:14:24 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:14:24 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:14:24 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe
Oct 23 23:14:24 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:14:24 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:14:24 user nova-compute[74482]: FIRMWARE:
Oct 23 23:14:24 user nova-compute[74482]: No targets found.
Oct 23 23:14:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:14:24 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:14:24 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0aea91-0ebc-43b1-b380-16e1c0814c97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af4f97c-c227-4095-8083-23a62dfa2c9d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:14:24 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:14:24 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:14:24 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:14:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:14:24 user nova-compute[74482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 (non-flash)
Oct 23 23:14:24 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:14:24 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:14:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3093596440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25'): ({'sde'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Removing single pathed devices sde {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[760ffa48-6c1d-49e3-b041-2e01e7100115]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d915db-898b-418f-90b5-b719438d234d]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Flushing IO for device /dev/sde {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[498b1c57-0b40-4d6d-8fca-5d6ac3779d01]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5a7320-d18e-494d-9a9e-17ae5fafc48c]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6416c3-a8e0-4dac-a6a3-20bc3506f275]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a7c5cb-600c-4209-95f9-133bcc3b7a8a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260]
Oct 23 23:14:24 user nova-compute[74482]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25, portal: 172.16.0.220,3260] successful.
Oct 23 23:14:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99cdd5d3-493b-47e7-a698-83647110de25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5f22e8-61a6-4ef5-94f3-efe897381397]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] <== disconnect_volume: return (366ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG nova.objects.instance [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'flavor' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-15b4a4bd-cfbb-4f03-b5a9-4825ecee2bc4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.226s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:14:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:14:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:14:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7510MB free_disk=24.844261169433594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:27 user nova-compute[74482]: INFO nova.compute.manager [None req-b66d0a5b-a7a7-4a25-a3ef-b68c25d75f11 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Unrescuing
Oct 23 23:14:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b66d0a5b-a7a7-4a25-a3ef-b68c25d75f11 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b66d0a5b-a7a7-4a25-a3ef-b68c25d75f11 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquired lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b66d0a5b-a7a7-4a25-a3ef-b68c25d75f11 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Applying migration context for instance c7b69955-1715-4185-8926-12b46b32227d as it has an incoming, in-progress migration 11c6e85e-fff3-49d1-9ca8-bb004c1d777a. Migration status is finished {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 23:14:27 user nova-compute[74482]: INFO nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating resource usage from migration 11c6e85e-fff3-49d1-9ca8-bb004c1d777a
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bbedc3ec-0f54-4977-8546-41ce4f488641 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance a18c958b-f7d9-47ba-ad98-332e12838d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 233cb56f-9cce-4c10-94db-cf694a20af1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 095c2860-554f-4622-902d-8cafda6dbfe9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 102b4a8c-5b4e-4620-825b-2935b0e46728 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Migration 11c6e85e-fff3-49d1-9ca8-bb004c1d777a is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7b69955-1715-4185-8926-12b46b32227d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:14:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b66d0a5b-a7a7-4a25-a3ef-b68c25d75f11 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Updating instance_info_cache with network_info: [{"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b66d0a5b-a7a7-4a25-a3ef-b68c25d75f11 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Releasing lock "refresh_cache-095c2860-554f-4622-902d-8cafda6dbfe9" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG nova.objects.instance [None req-b66d0a5b-a7a7-4a25-a3ef-b68c25d75f11 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'flavor' on Instance uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-a0ca8236-5e6f-431b-ada5-61277bc29774 req-4978e90f-c62d-4429-b97f-9d56f850c12b service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-unplugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a0ca8236-5e6f-431b-ada5-61277bc29774 req-4978e90f-c62d-4429-b97f-9d56f850c12b service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a0ca8236-5e6f-431b-ada5-61277bc29774 req-4978e90f-c62d-4429-b97f-9d56f850c12b service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a0ca8236-5e6f-431b-ada5-61277bc29774 req-4978e90f-c62d-4429-b97f-9d56f850c12b service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-a0ca8236-5e6f-431b-ada5-61277bc29774 req-4978e90f-c62d-4429-b97f-9d56f850c12b service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-unplugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:14:28 user nova-compute[74482]: WARNING nova.compute.manager [req-a0ca8236-5e6f-431b-ada5-61277bc29774 req-4978e90f-c62d-4429-b97f-9d56f850c12b service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-unplugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:14:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:29 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Instance destroyed successfully.
Oct 23 23:14:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:14:30 user nova-compute[74482]: WARNING nova.compute.manager [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:14:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:14:30 user nova-compute[74482]: WARNING nova.compute.manager [req-65bb8577-c22b-4f4c-84a2-c60efc404116 req-97dce6de-bd61-468d-ac7b-37067b245ae9 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state rescued and task_state unrescuing.
Oct 23 23:14:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b66d0a5b-a7a7-4a25-a3ef-b68c25d75f11 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:14:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-824e721d-76a5-4c03-bf03-3da4537fa5c3 req-3c02e50c-ef48-4621-9a4a-f4e6e417d19e service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-824e721d-76a5-4c03-bf03-3da4537fa5c3 req-3c02e50c-ef48-4621-9a4a-f4e6e417d19e service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-824e721d-76a5-4c03-bf03-3da4537fa5c3 req-3c02e50c-ef48-4621-9a4a-f4e6e417d19e service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-824e721d-76a5-4c03-bf03-3da4537fa5c3 req-3c02e50c-ef48-4621-9a4a-f4e6e417d19e service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-824e721d-76a5-4c03-bf03-3da4537fa5c3 req-3c02e50c-ef48-4621-9a4a-f4e6e417d19e service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:14:32 user nova-compute[74482]: WARNING nova.compute.manager [req-824e721d-76a5-4c03-bf03-3da4537fa5c3 req-3c02e50c-ef48-4621-9a4a-f4e6e417d19e service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state active and task_state None.
Oct 23 23:14:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:46 user nova-compute[74482]: INFO nova.compute.manager [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Terminating instance
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-551887ef-dcf9-47c0-87b9-bd173ab59214 req-18258458-378c-4369-9195-00eda6c3871c service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-unplugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-551887ef-dcf9-47c0-87b9-bd173ab59214 req-18258458-378c-4369-9195-00eda6c3871c service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-551887ef-dcf9-47c0-87b9-bd173ab59214 req-18258458-378c-4369-9195-00eda6c3871c service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-551887ef-dcf9-47c0-87b9-bd173ab59214 req-18258458-378c-4369-9195-00eda6c3871c service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-551887ef-dcf9-47c0-87b9-bd173ab59214 req-18258458-378c-4369-9195-00eda6c3871c service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-unplugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-551887ef-dcf9-47c0-87b9-bd173ab59214 req-18258458-378c-4369-9195-00eda6c3871c service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-unplugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Instance destroyed successfully.
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.objects.instance [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'resources' on Instance uuid 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:07:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1964417688',display_name='tempest-ServerRescueNegativeTestJSON-server-1964417688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1964417688',id=19,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT8VqUMB8rnh10l+ySFNmiC2m4ZblMqqwo0Xr/8hHga0olsqbmgYn1OrZ6ijsuJti0TkZOcVMOb7g9Pg4J6If3LXbS2hyryUQidVH8jZIQprpVD549e3rW+HR7Pt7DDSA==',key_name='tempest-keypair-20632901',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-8d8965bs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=03e1e9cb-0954-444f-baf5-cb2e2acd4b3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "address": "fa:16:3e:1b:84:96", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape28ce78b-25", "ovs_interfaceid": "e28ce78b-2583-4ef4-a071-d3b25fc5a3ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:84:96,bridge_name='br-int',has_traffic_filtering=True,id=e28ce78b-2583-4ef4-a071-d3b25fc5a3ea,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28ce78b-25') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG os_vif [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:84:96,bridge_name='br-int',has_traffic_filtering=True,id=e28ce78b-2583-4ef4-a071-d3b25fc5a3ea,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28ce78b-25') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape28ce78b-25, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6bd6252-c1a6-4866-95fc-fe108766b323) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:46 user nova-compute[74482]: INFO os_vif [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:84:96,bridge_name='br-int',has_traffic_filtering=True,id=e28ce78b-2583-4ef4-a071-d3b25fc5a3ea,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape28ce78b-25')
Oct 23 23:14:46 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Deleting instance files /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b_del
Oct 23 23:14:46 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Deletion of /opt/stack/data/nova/instances/03e1e9cb-0954-444f-baf5-cb2e2acd4b3b_del complete
Oct 23 23:14:46 user nova-compute[74482]: INFO nova.compute.manager [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 23 23:14:46 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:14:46 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:14:48 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Took 1.18 seconds to deallocate network for instance.
Oct 23 23:14:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-bac1035a-547a-48e3-a59a-9ecd5556c824 req-f3112461-67fd-48a7-8037-0dd38116cbfc service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bac1035a-547a-48e3-a59a-9ecd5556c824 req-f3112461-67fd-48a7-8037-0dd38116cbfc service nova] Acquiring lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bac1035a-547a-48e3-a59a-9ecd5556c824 req-f3112461-67fd-48a7-8037-0dd38116cbfc service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-bac1035a-547a-48e3-a59a-9ecd5556c824 req-f3112461-67fd-48a7-8037-0dd38116cbfc service nova] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-bac1035a-547a-48e3-a59a-9ecd5556c824 req-f3112461-67fd-48a7-8037-0dd38116cbfc service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] No waiting events found dispatching network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:14:48 user nova-compute[74482]: WARNING nova.compute.manager [req-bac1035a-547a-48e3-a59a-9ecd5556c824 req-f3112461-67fd-48a7-8037-0dd38116cbfc service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received unexpected event network-vif-plugged-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea for instance with vm_state deleted and task_state None.
Oct 23 23:14:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-bac1035a-547a-48e3-a59a-9ecd5556c824 req-f3112461-67fd-48a7-8037-0dd38116cbfc service nova] [instance: 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b] Received event network-vif-deleted-e28ce78b-2583-4ef4-a071-d3b25fc5a3ea {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:48 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Deleted allocations for instance 03e1e9cb-0954-444f-baf5-cb2e2acd4b3b
Oct 23 23:14:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-eaa86dba-03ab-4f28-8851-5dad8ae7f9a1 tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "03e1e9cb-0954-444f-baf5-cb2e2acd4b3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.635s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:14:58 user nova-compute[74482]: INFO nova.compute.manager [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Terminating instance
Oct 23 23:14:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:59 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Instance destroyed successfully.
Oct 23 23:14:59 user nova-compute[74482]: DEBUG nova.objects.instance [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'resources' on Instance uuid bbedc3ec-0f54-4977-8546-41ce4f488641 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:04:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-439136322',display_name='tempest-AttachVolumeTestJSON-server-439136322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-439136322',id=15,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2iGfEXaPgxPn5izpripEi2/XY/bHunM2ZOKB1jTII0azdkSPatKwlT3TbO7EwNnoRFvRzERTAu0AuwvB5cbX4ENLG57+jsj++oymIjEa63YTDE00owdCA8Ukeap2uu+A==',key_name='tempest-keypair-837672835',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-la2mgmq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=bbedc3ec-0f54-4977-8546-41ce4f488641,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "address": "fa:16:3e:f4:77:36", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b2e69e1-e9", "ovs_interfaceid": "9b2e69e1-e9e5-47ee-a252-cc7e568d4523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG os_vif [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b2e69e1-e9, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9093721a-8e7f-40f4-bebf-8e11a960217a) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:14:59 user nova-compute[74482]: INFO os_vif [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:77:36,bridge_name='br-int',has_traffic_filtering=True,id=9b2e69e1-e9e5-47ee-a252-cc7e568d4523,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b2e69e1-e9')
Oct 23 23:14:59 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Deleting instance files /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641_del
Oct 23 23:14:59 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Deletion of /opt/stack/data/nova/instances/bbedc3ec-0f54-4977-8546-41ce4f488641_del complete
Oct 23 23:14:59 user nova-compute[74482]: INFO nova.compute.manager [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 23 23:14:59 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:14:59 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Took 0.69 seconds to deallocate network for instance.
Oct 23 23:14:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:14:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-66ab3512-d8b8-4695-b310-c40ad47b41d1 req-b8f5d6ac-607b-4372-933c-4e1ff26edd5c service nova] [instance: bbedc3ec-0f54-4977-8546-41ce4f488641] Received event network-vif-deleted-9b2e69e1-e9e5-47ee-a252-cc7e568d4523 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:00 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:15:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:15:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.666s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:00 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Deleted allocations for instance bbedc3ec-0f54-4977-8546-41ce4f488641
Oct 23 23:15:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0d87cc61-2eaf-4ee7-b7c6-e044620be2a6 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "bbedc3ec-0f54-4977-8546-41ce4f488641" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:15:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:15:02 user nova-compute[74482]: INFO nova.compute.claims [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Claim successful on node user
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:03 user nova-compute[74482]: INFO nova.compute.manager [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Terminating instance
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:15:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.policy [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b40f4844df3a432aa3f098c2fcfb7d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c319ace5e2ae44b492554cc7e4365adc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:15:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Creating image(s)
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "/opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "/opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "/opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-29a198ba-567b-4361-a6c7-6bbb45a3a774 req-0769be9d-d7d1-4f91-8ca9-c102264f2d34 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-unplugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-29a198ba-567b-4361-a6c7-6bbb45a3a774 req-0769be9d-d7d1-4f91-8ca9-c102264f2d34 service nova] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-29a198ba-567b-4361-a6c7-6bbb45a3a774 req-0769be9d-d7d1-4f91-8ca9-c102264f2d34 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-29a198ba-567b-4361-a6c7-6bbb45a3a774 req-0769be9d-d7d1-4f91-8ca9-c102264f2d34 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-29a198ba-567b-4361-a6c7-6bbb45a3a774 req-0769be9d-d7d1-4f91-8ca9-c102264f2d34 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] No waiting events found dispatching network-vif-unplugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:15:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-29a198ba-567b-4361-a6c7-6bbb45a3a774 req-0769be9d-d7d1-4f91-8ca9-c102264f2d34 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-unplugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk 1073741824" returned: 0 in 0.052s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:04 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Instance destroyed successfully.
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'resources' on Instance uuid 233cb56f-9cce-4c10-94db-cf694a20af1f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-950332835',display_name='tempest-TestMinimumBasicScenario-server-950332835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-950332835',id=22,image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG8dgWQuRHRcLtDLX4CB3F97QOTyGUchFE4KCjIBlG9aoZYNxbOzHcdZhg2VJjRM/RAp+PzivptFgF5OTQl2OLvi7mZOYBYkFv0tzEOK5lfUUpR+6KPBIbQ/TraHJ145g==',key_name='tempest-TestMinimumBasicScenario-439322620',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf59ee373fd04ceda1c9212af985f052',ramdisk_id='',reservation_id='r-t08kgi8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5487da70-f1de-4665-a9d6-6b9ab731970f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-964628947',owner_user_name='tempest-TestMinimumBasicScenario-964628947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:12:19Z,user_data=None,user_id='58e1ae75bd484d3ea749e10346671167',uuid=233cb56f-9cce-4c10-94db-cf694a20af1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converting VIF {"id": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "address": "fa:16:3e:ca:2a:fe", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb4eca63-00", "ovs_interfaceid": "fb4eca63-002e-4eaf-b6ef-f2d6f558f20a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG os_vif [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb4eca63-00, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f81978d-39a2-4025-9103-9477d2380cd7) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:04 user nova-compute[74482]: INFO os_vif [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=fb4eca63-002e-4eaf-b6ef-f2d6f558f20a,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb4eca63-00')
Oct 23 23:15:04 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Deleting instance files /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f_del
Oct 23 23:15:04 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Deletion of /opt/stack/data/nova/instances/233cb56f-9cce-4c10-94db-cf694a20af1f_del complete
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Successfully created port: fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.211s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:04 user nova-compute[74482]: INFO nova.compute.manager [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Cannot resize image /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Ensure instance console log exists: /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:04 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Took 0.39 seconds to deallocate network for instance.
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Successfully updated port: fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquired lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-d5b6dad0-abe5-4722-be51-5508bf246593 req-9ff78823-a8fe-4d49-a26d-718d2813d856 service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received event network-changed-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-d5b6dad0-abe5-4722-be51-5508bf246593 req-9ff78823-a8fe-4d49-a26d-718d2813d856 service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Refreshing instance network info cache due to event network-changed-fa4e5017-0b5a-4b46-b88b-35253303446c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d5b6dad0-abe5-4722-be51-5508bf246593 req-9ff78823-a8fe-4d49-a26d-718d2813d856 service nova] Acquiring lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating instance_info_cache with network_info: [{"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:05 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Deleted allocations for instance 233cb56f-9cce-4c10-94db-cf694a20af1f
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Releasing lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Instance network_info: |[{"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d5b6dad0-abe5-4722-be51-5508bf246593 req-9ff78823-a8fe-4d49-a26d-718d2813d856 service nova] Acquired lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.neutron [req-d5b6dad0-abe5-4722-be51-5508bf246593 req-9ff78823-a8fe-4d49-a26d-718d2813d856 service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Refreshing network info cache for port fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Start _get_guest_xml network_info=[{"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:15:05 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:15:05 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2035983438',display_name='tempest-SnapshotDataIntegrityTests-server-2035983438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2035983438',id=27,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3Jrr4zeyeR5kezuGPYaBTpttUcWtPabF+I2uTrGK8THhlOf4RG8EMDw70nx3iUaXMeEAIitOdKijVTJL9nZArjdX09QFPFW52cNUIBudHJbdB6XoC1GInrENKXiFRwkQ==',key_name='tempest-keypair-429130050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c319ace5e2ae44b492554cc7e4365adc',ramdisk_id='',reservation_id='r-dlzvjlac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1098454545',owner_user_name='tempest-SnapshotDataIntegrityTests-1098454545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:15:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b40f4844df3a432aa3f098c2fcfb7d5a',uuid=127d7315-74d4-4905-b203-67556d26e3c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Converting VIF {"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5e:d4,bridge_name='br-int',has_traffic_filtering=True,id=fa4e5017-0b5a-4b46-b88b-35253303446c,network=Network(7e6f2082-7aed-4920-9f34-0a3c2138ce65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4e5017-0b') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'pci_devices' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:15:05 user nova-compute[74482]:   <uuid>127d7315-74d4-4905-b203-67556d26e3c3</uuid>
Oct 23 23:15:05 user nova-compute[74482]:   <name>instance-0000001b</name>
Oct 23 23:15:05 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:15:05 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:15:05 user nova-compute[74482]:   <metadata>
Oct 23 23:15:05 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:15:05 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:15:05 user nova-compute[74482]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2035983438</nova:name>
Oct 23 23:15:05 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:15:05</nova:creationTime>
Oct 23 23:15:05 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:15:05 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:15:05 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:15:05 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:15:05 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:15:05 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:15:05 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:15:05 user nova-compute[74482]:       <nova:owner>
Oct 23 23:15:05 user nova-compute[74482]:         <nova:user uuid="b40f4844df3a432aa3f098c2fcfb7d5a">tempest-SnapshotDataIntegrityTests-1098454545-project-member</nova:user>
Oct 23 23:15:05 user nova-compute[74482]:         <nova:project uuid="c319ace5e2ae44b492554cc7e4365adc">tempest-SnapshotDataIntegrityTests-1098454545</nova:project>
Oct 23 23:15:05 user nova-compute[74482]:       </nova:owner>
Oct 23 23:15:05 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:15:05 user nova-compute[74482]:       <nova:ports>
Oct 23 23:15:05 user nova-compute[74482]:         <nova:port uuid="fa4e5017-0b5a-4b46-b88b-35253303446c">
Oct 23 23:15:05 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 23:15:05 user nova-compute[74482]:         </nova:port>
Oct 23 23:15:05 user nova-compute[74482]:       </nova:ports>
Oct 23 23:15:05 user nova-compute[74482]:     </nova:instance>
Oct 23 23:15:05 user nova-compute[74482]:   </metadata>
Oct 23 23:15:05 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:15:05 user nova-compute[74482]:     <system>
Oct 23 23:15:05 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:15:05 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:15:05 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:15:05 user nova-compute[74482]:       <entry name="serial">127d7315-74d4-4905-b203-67556d26e3c3</entry>
Oct 23 23:15:05 user nova-compute[74482]:       <entry name="uuid">127d7315-74d4-4905-b203-67556d26e3c3</entry>
Oct 23 23:15:05 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:15:05 user nova-compute[74482]:     </system>
Oct 23 23:15:05 user nova-compute[74482]:   </sysinfo>
Oct 23 23:15:05 user nova-compute[74482]:   <os>
Oct 23 23:15:05 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:15:05 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:15:05 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:15:05 user nova-compute[74482]:   </os>
Oct 23 23:15:05 user nova-compute[74482]:   <features>
Oct 23 23:15:05 user nova-compute[74482]:     <acpi/>
Oct 23 23:15:05 user nova-compute[74482]:     <apic/>
Oct 23 23:15:05 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:15:05 user nova-compute[74482]:   </features>
Oct 23 23:15:05 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:15:05 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:15:05 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:15:05 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:15:05 user nova-compute[74482]:   </clock>
Oct 23 23:15:05 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:15:05 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:15:05 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:15:05 user nova-compute[74482]:   </cpu>
Oct 23 23:15:05 user nova-compute[74482]:   <devices>
Oct 23 23:15:05 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:15:05 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:15:05 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk"/>
Oct 23 23:15:05 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:15:05 user nova-compute[74482]:     </disk>
Oct 23 23:15:05 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:15:05 user nova-compute[74482]:       <mac address="fa:16:3e:f8:5e:d4"/>
Oct 23 23:15:05 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:15:05 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:15:05 user nova-compute[74482]:       <target dev="tapfa4e5017-0b"/>
Oct 23 23:15:05 user nova-compute[74482]:     </interface>
Oct 23 23:15:05 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:15:05 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/console.log" append="off"/>
Oct 23 23:15:05 user nova-compute[74482]:     </serial>
Oct 23 23:15:05 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:15:05 user nova-compute[74482]:     <video>
Oct 23 23:15:05 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:15:05 user nova-compute[74482]:     </video>
Oct 23 23:15:05 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:15:05 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:15:05 user nova-compute[74482]:     </rng>
Oct 23 23:15:05 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:15:05 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:15:05 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:15:05 user nova-compute[74482]:     </memballoon>
Oct 23 23:15:05 user nova-compute[74482]:   </devices>
Oct 23 23:15:05 user nova-compute[74482]: </domain>
Oct 23 23:15:05 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2035983438',display_name='tempest-SnapshotDataIntegrityTests-server-2035983438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2035983438',id=27,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3Jrr4zeyeR5kezuGPYaBTpttUcWtPabF+I2uTrGK8THhlOf4RG8EMDw70nx3iUaXMeEAIitOdKijVTJL9nZArjdX09QFPFW52cNUIBudHJbdB6XoC1GInrENKXiFRwkQ==',key_name='tempest-keypair-429130050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c319ace5e2ae44b492554cc7e4365adc',ramdisk_id='',reservation_id='r-dlzvjlac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1098454545',owner_user_name='tempest-SnapshotDataIntegrityTests-1098454545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:15:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b40f4844df3a432aa3f098c2fcfb7d5a',uuid=127d7315-74d4-4905-b203-67556d26e3c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Converting VIF {"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5e:d4,bridge_name='br-int',has_traffic_filtering=True,id=fa4e5017-0b5a-4b46-b88b-35253303446c,network=Network(7e6f2082-7aed-4920-9f34-0a3c2138ce65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4e5017-0b') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG os_vif [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5e:d4,bridge_name='br-int',has_traffic_filtering=True,id=fa4e5017-0b5a-4b46-b88b-35253303446c,network=Network(7e6f2082-7aed-4920-9f34-0a3c2138ce65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4e5017-0b') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c98fc1e4-bd01-4e8c-9ab4-566e6243ada8 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.019s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6cd1831-55b0-5d9e-b452-2dcb56ccb6cf', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa4e5017-0b, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa4e5017-0b, col_values=(('qos', UUID('0eac894e-bb34-42d6-9461-94fce9adfc25')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa4e5017-0b, col_values=(('external_ids', {'iface-id': 'fa4e5017-0b5a-4b46-b88b-35253303446c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:5e:d4', 'vm-uuid': '127d7315-74d4-4905-b203-67556d26e3c3'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:05 user nova-compute[74482]: INFO os_vif [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:5e:d4,bridge_name='br-int',has_traffic_filtering=True,id=fa4e5017-0b5a-4b46-b88b-35253303446c,network=Network(7e6f2082-7aed-4920-9f34-0a3c2138ce65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4e5017-0b')
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No VIF found with MAC fa:16:3e:f8:5e:d4, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.neutron [req-d5b6dad0-abe5-4722-be51-5508bf246593 req-9ff78823-a8fe-4d49-a26d-718d2813d856 service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updated VIF entry in instance network info cache for port fa4e5017-0b5a-4b46-b88b-35253303446c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.network.neutron [req-d5b6dad0-abe5-4722-be51-5508bf246593 req-9ff78823-a8fe-4d49-a26d-718d2813d856 service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating instance_info_cache with network_info: [{"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d5b6dad0-abe5-4722-be51-5508bf246593 req-9ff78823-a8fe-4d49-a26d-718d2813d856 service nova] Releasing lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-10f4a73b-8398-491e-8f80-dde6b79979e8 req-3b20249c-481c-4247-bb81-79b564cd26c0 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-10f4a73b-8398-491e-8f80-dde6b79979e8 req-3b20249c-481c-4247-bb81-79b564cd26c0 service nova] Acquiring lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-10f4a73b-8398-491e-8f80-dde6b79979e8 req-3b20249c-481c-4247-bb81-79b564cd26c0 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-10f4a73b-8398-491e-8f80-dde6b79979e8 req-3b20249c-481c-4247-bb81-79b564cd26c0 service nova] Lock "233cb56f-9cce-4c10-94db-cf694a20af1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-10f4a73b-8398-491e-8f80-dde6b79979e8 req-3b20249c-481c-4247-bb81-79b564cd26c0 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] No waiting events found dispatching network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:15:05 user nova-compute[74482]: WARNING nova.compute.manager [req-10f4a73b-8398-491e-8f80-dde6b79979e8 req-3b20249c-481c-4247-bb81-79b564cd26c0 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received unexpected event network-vif-plugged-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a for instance with vm_state deleted and task_state None.
Oct 23 23:15:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-10f4a73b-8398-491e-8f80-dde6b79979e8 req-3b20249c-481c-4247-bb81-79b564cd26c0 service nova] [instance: 233cb56f-9cce-4c10-94db-cf694a20af1f] Received event network-vif-deleted-fb4eca63-002e-4eaf-b6ef-f2d6f558f20a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-842c6f79-a169-4686-9daa-62411f352b31 req-a12308aa-f015-4cb6-8a0a-7d7488f4095d service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received event network-vif-plugged-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-842c6f79-a169-4686-9daa-62411f352b31 req-a12308aa-f015-4cb6-8a0a-7d7488f4095d service nova] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-842c6f79-a169-4686-9daa-62411f352b31 req-a12308aa-f015-4cb6-8a0a-7d7488f4095d service nova] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-842c6f79-a169-4686-9daa-62411f352b31 req-a12308aa-f015-4cb6-8a0a-7d7488f4095d service nova] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-842c6f79-a169-4686-9daa-62411f352b31 req-a12308aa-f015-4cb6-8a0a-7d7488f4095d service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] No waiting events found dispatching network-vif-plugged-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:15:07 user nova-compute[74482]: WARNING nova.compute.manager [req-842c6f79-a169-4686-9daa-62411f352b31 req-a12308aa-f015-4cb6-8a0a-7d7488f4095d service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received unexpected event network-vif-plugged-fa4e5017-0b5a-4b46-b88b-35253303446c for instance with vm_state building and task_state spawning.
Oct 23 23:15:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:15:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:15:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:15:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Instance spawned successfully.
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:09 user nova-compute[74482]: INFO nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:15:09 user nova-compute[74482]: INFO nova.compute.manager [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Took 6.62 seconds to build instance.
Oct 23 23:15:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ba505481-9056-4223-8bdd-628e75a5c0b6 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.736s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-7f7553a9-bd59-4b54-b72b-c79f12d6743d req-0c9186d0-536d-4097-b24a-48296b0f933d service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received event network-vif-plugged-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7f7553a9-bd59-4b54-b72b-c79f12d6743d req-0c9186d0-536d-4097-b24a-48296b0f933d service nova] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7f7553a9-bd59-4b54-b72b-c79f12d6743d req-0c9186d0-536d-4097-b24a-48296b0f933d service nova] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7f7553a9-bd59-4b54-b72b-c79f12d6743d req-0c9186d0-536d-4097-b24a-48296b0f933d service nova] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-7f7553a9-bd59-4b54-b72b-c79f12d6743d req-0c9186d0-536d-4097-b24a-48296b0f933d service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] No waiting events found dispatching network-vif-plugged-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:15:09 user nova-compute[74482]: WARNING nova.compute.manager [req-7f7553a9-bd59-4b54-b72b-c79f12d6743d req-0c9186d0-536d-4097-b24a-48296b0f933d service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received unexpected event network-vif-plugged-fa4e5017-0b5a-4b46-b88b-35253303446c for instance with vm_state active and task_state None.
Oct 23 23:15:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:11 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:15:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:15:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:15:11 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:15:12 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updating instance_info_cache with network_info: [{"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-2c51493a-92fc-4297-9ba9-8ee2770c8eb0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:15:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:15:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_power_states {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid fc2566c6-8911-425b-b05d-a008e67a9d34 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid c7e4371a-32f9-4156-bea9-b7c4b5df3100 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid a18c958b-f7d9-47ba-ad98-332e12838d81 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid c7b69955-1715-4185-8926-12b46b32227d {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 102b4a8c-5b4e-4620-825b-2935b0e46728 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "fc2566c6-8911-425b-b05d-a008e67a9d34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "95802cf3-56ba-4224-a333-e00e54c72166" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "095c2860-554f-4622-902d-8cafda6dbfe9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "c7b69955-1715-4185-8926-12b46b32227d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "95802cf3-56ba-4224-a333-e00e54c72166" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "c7b69955-1715-4185-8926-12b46b32227d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "095c2860-554f-4622-902d-8cafda6dbfe9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:15:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:15:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:15:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:15:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:15:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:15:28 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:15:28 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7598MB free_disk=24.899436950683594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Applying migration context for instance c7b69955-1715-4185-8926-12b46b32227d as it has an incoming, in-progress migration 11c6e85e-fff3-49d1-9ca8-bb004c1d777a. Migration status is finished {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 23:15:28 user nova-compute[74482]: INFO nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating resource usage from migration 11c6e85e-fff3-49d1-9ca8-bb004c1d777a
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 95802cf3-56ba-4224-a333-e00e54c72166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance a18c958b-f7d9-47ba-ad98-332e12838d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 095c2860-554f-4622-902d-8cafda6dbfe9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 102b4a8c-5b4e-4620-825b-2935b0e46728 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Migration 11c6e85e-fff3-49d1-9ca8-bb004c1d777a is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7b69955-1715-4185-8926-12b46b32227d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 127d7315-74d4-4905-b203-67556d26e3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.objects.instance [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lazy-loading 'flavor' on Instance uuid 102b4a8c-5b4e-4620-825b-2935b0e46728 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:28 user nova-compute[74482]: INFO nova.compute.manager [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Attaching volume 4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 to /dev/vdb
Oct 23 23:15:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.741s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG os_brick.utils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:15:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2451a4d8-31fe-4eb9-aab7-6222935c4a7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5922f0d-b374-4ac7-86fd-92b6a21155a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db211c6-49b5-4e87-bd20-36d2ed7f0f74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a27d2cf-9bee-4f9f-bd8e-2c1208241ed9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:15:29 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b159c768-36b5-44b7-8154-af4d21c2d62c]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG os_brick.utils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Updating existing volume attachment record: 9dab4c87-2fa4-4b02-bce2-1075fc33d598 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:15:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:15:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG nova.compute.manager [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Going to confirm migration 2 {{(pid=74482) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquired lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG nova.network.neutron [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG nova.objects.instance [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'info_cache' on Instance uuid c7b69955-1715-4185-8926-12b46b32227d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG nova.network.neutron [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating instance_info_cache with network_info: [{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Releasing lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:15:42 user nova-compute[74482]: DEBUG nova.objects.instance [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'migration_context' on Instance uuid c7b69955-1715-4185-8926-12b46b32227d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:15:43 user nova-compute[74482]: DEBUG nova.objects.base [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Object Instance<c7b69955-1715-4185-8926-12b46b32227d> lazy-loaded attributes: info_cache,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:15:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:43 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:15:43 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:15:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.438s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:43 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Deleted allocation for migration 11c6e85e-fff3-49d1-9ca8-bb004c1d777a
Oct 23 23:15:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-921ff070-feef-410a-a1d4-1b04cedc6ea2 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.331s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:15:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:15:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:15:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gekLUtyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:15:46 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:15:46 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:15:46 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceca991c-8d06-415c-acb0-fd0daf9f7698]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:15:46 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3876ad4d-951d-4779-a2c7-b8c09af7eca1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9] added
Oct 23 23:15:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c15263-bfea-4eac-874f-8802858f6676]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c29122f-4893-44ad-b350-8ff9246611aa]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gekLUtyI {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gekLUtyI" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599048b-542d-4e2a-955a-b6ab5f7411c1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gekLUtyI'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5b7a51-f8b5-41f2-8a81-bf8bbf4a8e3e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ffc607-c123-41f9-8dda-b6b40bb2b492]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e94de3-2865-4a33-bc7a-bb0b29ebb09f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9, portal: 172.16.0.220,3260]
Oct 23 23:15:46 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9, portal: 172.16.0.220,3260] successful.
Oct 23 23:15:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd63e2-53ba-48b6-9234-b20388df5fde]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab7226f-4cf1-4bb2-b793-92f343d86c93]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:15:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab46f2bc-8951-48c8-ae49-f9dad6edcafa]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:15:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gekLUtyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:15:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:15:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23133616134346139', 'path': '/dev/sde'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:15:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133616134346139', 'path': '/dev/sde'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:15:47 user nova-compute[74482]: DEBUG nova.objects.instance [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lazy-loading 'flavor' on Instance uuid 102b4a8c-5b4e-4620-825b-2935b0e46728 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:15:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:15:47 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:15:47 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:15:47 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:15:47 user nova-compute[74482]:   <serial>4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9</serial>
Oct 23 23:15:47 user nova-compute[74482]: </disk>
Oct 23 23:15:47 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:15:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:15:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:15:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] No VIF found with MAC fa:16:3e:db:22:90, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:15:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0fe83683-9248-495b-9773-91e64b6b1749 tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.609s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:49 user nova-compute[74482]: INFO nova.compute.manager [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Terminating instance
Oct 23 23:15:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-42eb65be-eef0-4d70-ba0b-eda862d05b5b req-e5011434-4b87-43d4-9a49-6b43d566e4b9 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received event network-vif-unplugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-42eb65be-eef0-4d70-ba0b-eda862d05b5b req-e5011434-4b87-43d4-9a49-6b43d566e4b9 service nova] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-42eb65be-eef0-4d70-ba0b-eda862d05b5b req-e5011434-4b87-43d4-9a49-6b43d566e4b9 service nova] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-42eb65be-eef0-4d70-ba0b-eda862d05b5b req-e5011434-4b87-43d4-9a49-6b43d566e4b9 service nova] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-42eb65be-eef0-4d70-ba0b-eda862d05b5b req-e5011434-4b87-43d4-9a49-6b43d566e4b9 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] No waiting events found dispatching network-vif-unplugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-42eb65be-eef0-4d70-ba0b-eda862d05b5b req-e5011434-4b87-43d4-9a49-6b43d566e4b9 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received event network-vif-unplugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:15:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Instance destroyed successfully.
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.objects.instance [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lazy-loading 'resources' on Instance uuid 102b4a8c-5b4e-4620-825b-2935b0e46728 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1248908934',display_name='tempest-DeleteServersTestJSON-server-1248908934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1248908934',id=26,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:13:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='692170d5af714ece938c945f271848b0',ramdisk_id='',reservation_id='r-02g5iuex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1727172578',owner_user_name='tempest-DeleteServersTestJSON-1727172578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:13:41Z,user_data=None,user_id='27c14666f4cf4c7bb290aa64186ae51d',uuid=102b4a8c-5b4e-4620-825b-2935b0e46728,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Converting VIF {"id": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "address": "fa:16:3e:db:22:90", "network": {"id": "35da1dd5-78c6-446e-a484-dbcacc570fd3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1350599200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "692170d5af714ece938c945f271848b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb37dc75d-16", "ovs_interfaceid": "b37dc75d-16ac-40b4-b0e1-36c6625d095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:90,bridge_name='br-int',has_traffic_filtering=True,id=b37dc75d-16ac-40b4-b0e1-36c6625d095a,network=Network(35da1dd5-78c6-446e-a484-dbcacc570fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb37dc75d-16') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_vif [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:90,bridge_name='br-int',has_traffic_filtering=True,id=b37dc75d-16ac-40b4-b0e1-36c6625d095a,network=Network(35da1dd5-78c6-446e-a484-dbcacc570fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb37dc75d-16') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb37dc75d-16, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d59b8f79-3c3e-41be-bcd2-3dac7b622001) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:50 user nova-compute[74482]: INFO os_vif [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:22:90,bridge_name='br-int',has_traffic_filtering=True,id=b37dc75d-16ac-40b4-b0e1-36c6625d095a,network=Network(35da1dd5-78c6-446e-a484-dbcacc570fd3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb37dc75d-16')
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gekLUtyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:15:50 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e17d1d-ede8-422f-8ee3-8264b27bf8a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:15:50 user nova-compute[74482]: No targets found.
Oct 23 23:15:50 user nova-compute[74482]: iSNS:
Oct 23 23:15:50 user nova-compute[74482]: No targets found.
Oct 23 23:15:50 user nova-compute[74482]: STATIC:
Oct 23 23:15:50 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9
Oct 23 23:15:50 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:15:50 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:15:50 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:15:50 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:15:50 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:15:50 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18
Oct 23 23:15:50 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:15:50 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:15:50 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe
Oct 23 23:15:50 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:15:50 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:15:50 user nova-compute[74482]: FIRMWARE:
Oct 23 23:15:50 user nova-compute[74482]: No targets found.
Oct 23 23:15:50 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:15:50 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:15:50 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ca4a70-6b78-47a6-8638-6e0e804a5c81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f184b4b-1231-452d-9d19-f5437d18897c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:15:50 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:15:50 user nova-compute[74482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 (non-flash)
Oct 23 23:15:50 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:15:50 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:15:50 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:15:50 user nova-compute[74482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 (non-flash)
Oct 23 23:15:50 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:15:50 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c5ba950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9'): ({'sde'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Removing single pathed devices sde {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[22405a1f-cd8a-4ad9-beac-43a014680182]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f35ab5f-db22-4601-99ce-2fa4be58bf13]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Flushing IO for device /dev/sde {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1645f819-1c0f-4837-977c-1343fe04cde8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e314ec-f252-460a-91bc-2cf0af272b41]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[04edd80f-bbc6-4386-a11f-1e0dcbdb645a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee58f0e-ee7b-449b-aeed-fae061863936]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9, portal: 172.16.0.220,3260]
Oct 23 23:15:50 user nova-compute[74482]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9, portal: 172.16.0.220,3260] successful.
Oct 23 23:15:50 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aaea49b-77dd-44f6-89e3-01e2d7cdd4a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[974a4b3d-82e6-4abd-aa1c-df8edf4f04ed]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] <== disconnect_volume: return (326ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:15:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Deleting instance files /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728_del
Oct 23 23:15:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Deletion of /opt/stack/data/nova/instances/102b4a8c-5b4e-4620-825b-2935b0e46728_del complete
Oct 23 23:15:50 user nova-compute[74482]: INFO nova.compute.manager [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Took 1.43 seconds to destroy the instance on the hypervisor.
Oct 23 23:15:50 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:15:50 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:15:51 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:51 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Took 0.46 seconds to deallocate network for instance.
Oct 23 23:15:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-07caa012-e081-4fbc-a4e9-5a4d7325e83e req-a1cfaef5-51df-4e60-8e62-ac6420bf213d service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received event network-vif-deleted-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:51 user nova-compute[74482]: INFO nova.compute.manager [req-07caa012-e081-4fbc-a4e9-5a4d7325e83e req-a1cfaef5-51df-4e60-8e62-ac6420bf213d service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Neutron deleted interface b37dc75d-16ac-40b4-b0e1-36c6625d095a; detaching it from the instance and deleting it from the info cache
Oct 23 23:15:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-07caa012-e081-4fbc-a4e9-5a4d7325e83e req-a1cfaef5-51df-4e60-8e62-ac6420bf213d service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-07caa012-e081-4fbc-a4e9-5a4d7325e83e req-a1cfaef5-51df-4e60-8e62-ac6420bf213d service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Detach interface failed, port_id=b37dc75d-16ac-40b4-b0e1-36c6625d095a, reason: Instance 102b4a8c-5b4e-4620-825b-2935b0e46728 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-c7ca61a1-be93-4f4e-a2c5-bb91df5228df req-6ceb6082-a5f9-412f-9395-dcb6f1696661 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received event network-vif-plugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c7ca61a1-be93-4f4e-a2c5-bb91df5228df req-6ceb6082-a5f9-412f-9395-dcb6f1696661 service nova] Acquiring lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c7ca61a1-be93-4f4e-a2c5-bb91df5228df req-6ceb6082-a5f9-412f-9395-dcb6f1696661 service nova] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c7ca61a1-be93-4f4e-a2c5-bb91df5228df req-6ceb6082-a5f9-412f-9395-dcb6f1696661 service nova] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-c7ca61a1-be93-4f4e-a2c5-bb91df5228df req-6ceb6082-a5f9-412f-9395-dcb6f1696661 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] No waiting events found dispatching network-vif-plugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:15:52 user nova-compute[74482]: WARNING nova.compute.manager [req-c7ca61a1-be93-4f4e-a2c5-bb91df5228df req-6ceb6082-a5f9-412f-9395-dcb6f1696661 service nova] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Received unexpected event network-vif-plugged-b37dc75d-16ac-40b4-b0e1-36c6625d095a for instance with vm_state active and task_state deleting.
Oct 23 23:15:52 user nova-compute[74482]: INFO nova.compute.manager [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] [instance: 102b4a8c-5b4e-4620-825b-2935b0e46728] Took 0.90 seconds to detach 1 volumes for instance.
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:52 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Deleted allocations for instance 102b4a8c-5b4e-4620-825b-2935b0e46728
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2243a2e6-5c74-4bd5-b2c3-e8c1dcf0af7a tempest-DeleteServersTestJSON-1727172578 tempest-DeleteServersTestJSON-1727172578-project-member] Lock "102b4a8c-5b4e-4620-825b-2935b0e46728" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.380s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:15:52 user nova-compute[74482]: INFO nova.compute.claims [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Claim successful on node user
Oct 23 23:15:53 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:15:53 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:15:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG nova.policy [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba4aeef9339f48d6929e4cfa97af0860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef228274d9477091fcd021ca8271e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:15:53 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Creating image(s)
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "/opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "/opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.195s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.202s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk 1073741824" returned: 0 in 0.060s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Cannot resize image /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Ensure instance console log exists: /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:54 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Successfully created port: 1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Successfully updated port: 1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "refresh_cache-d2ea53e4-399b-4b7a-9338-c1c81b3a6253" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquired lock "refresh_cache-d2ea53e4-399b-4b7a-9338-c1c81b3a6253" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-c9e05e1e-33cd-4934-bab0-c9ca03e58309 req-c144d02c-587c-4179-9fab-f1288995f600 service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received event network-changed-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-c9e05e1e-33cd-4934-bab0-c9ca03e58309 req-c144d02c-587c-4179-9fab-f1288995f600 service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Refreshing instance network info cache due to event network-changed-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c9e05e1e-33cd-4934-bab0-c9ca03e58309 req-c144d02c-587c-4179-9fab-f1288995f600 service nova] Acquiring lock "refresh_cache-d2ea53e4-399b-4b7a-9338-c1c81b3a6253" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Updating instance_info_cache with network_info: [{"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Releasing lock "refresh_cache-d2ea53e4-399b-4b7a-9338-c1c81b3a6253" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Instance network_info: |[{"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c9e05e1e-33cd-4934-bab0-c9ca03e58309 req-c144d02c-587c-4179-9fab-f1288995f600 service nova] Acquired lock "refresh_cache-d2ea53e4-399b-4b7a-9338-c1c81b3a6253" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-c9e05e1e-33cd-4934-bab0-c9ca03e58309 req-c144d02c-587c-4179-9fab-f1288995f600 service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Refreshing network info cache for port 1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Start _get_guest_xml network_info=[{"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:15:55 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:15:55 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-213171726',display_name='tempest-AttachVolumeTestJSON-server-213171726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-213171726',id=28,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQiBkkPCnvve16LbgMhmUeQ7YP2NPZIWJYitMCOMUuCTlsH9lj5NQWmm7u2keAgnpGzKeCbxM7Rz8bU6gv8GfJBhWF3Px2aXTQZxQyyiMI5j3a1N6rUlmCDf06AiUbSyg==',key_name='tempest-keypair-1365969527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-aw82trdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=d2ea53e4-399b-4b7a-9338-c1c81b3a6253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:b0:fe,bridge_name='br-int',has_traffic_filtering=True,id=1f23deed-5e0c-4e81-858d-9fa8ee97b9f1,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f23deed-5e') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'pci_devices' on Instance uuid d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:15:55 user nova-compute[74482]:   <uuid>d2ea53e4-399b-4b7a-9338-c1c81b3a6253</uuid>
Oct 23 23:15:55 user nova-compute[74482]:   <name>instance-0000001c</name>
Oct 23 23:15:55 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:15:55 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:15:55 user nova-compute[74482]:   <metadata>
Oct 23 23:15:55 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:15:55 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:15:55 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeTestJSON-server-213171726</nova:name>
Oct 23 23:15:55 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:15:55</nova:creationTime>
Oct 23 23:15:55 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:15:55 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:15:55 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:15:55 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:15:55 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:15:55 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:15:55 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:15:55 user nova-compute[74482]:       <nova:owner>
Oct 23 23:15:55 user nova-compute[74482]:         <nova:user uuid="ba4aeef9339f48d6929e4cfa97af0860">tempest-AttachVolumeTestJSON-1506893999-project-member</nova:user>
Oct 23 23:15:55 user nova-compute[74482]:         <nova:project uuid="5bef228274d9477091fcd021ca8271e3">tempest-AttachVolumeTestJSON-1506893999</nova:project>
Oct 23 23:15:55 user nova-compute[74482]:       </nova:owner>
Oct 23 23:15:55 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:15:55 user nova-compute[74482]:       <nova:ports>
Oct 23 23:15:55 user nova-compute[74482]:         <nova:port uuid="1f23deed-5e0c-4e81-858d-9fa8ee97b9f1">
Oct 23 23:15:55 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 23:15:55 user nova-compute[74482]:         </nova:port>
Oct 23 23:15:55 user nova-compute[74482]:       </nova:ports>
Oct 23 23:15:55 user nova-compute[74482]:     </nova:instance>
Oct 23 23:15:55 user nova-compute[74482]:   </metadata>
Oct 23 23:15:55 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:15:55 user nova-compute[74482]:     <system>
Oct 23 23:15:55 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:15:55 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:15:55 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:15:55 user nova-compute[74482]:       <entry name="serial">d2ea53e4-399b-4b7a-9338-c1c81b3a6253</entry>
Oct 23 23:15:55 user nova-compute[74482]:       <entry name="uuid">d2ea53e4-399b-4b7a-9338-c1c81b3a6253</entry>
Oct 23 23:15:55 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:15:55 user nova-compute[74482]:     </system>
Oct 23 23:15:55 user nova-compute[74482]:   </sysinfo>
Oct 23 23:15:55 user nova-compute[74482]:   <os>
Oct 23 23:15:55 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:15:55 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:15:55 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:15:55 user nova-compute[74482]:   </os>
Oct 23 23:15:55 user nova-compute[74482]:   <features>
Oct 23 23:15:55 user nova-compute[74482]:     <acpi/>
Oct 23 23:15:55 user nova-compute[74482]:     <apic/>
Oct 23 23:15:55 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:15:55 user nova-compute[74482]:   </features>
Oct 23 23:15:55 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:15:55 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:15:55 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:15:55 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:15:55 user nova-compute[74482]:   </clock>
Oct 23 23:15:55 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:15:55 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:15:55 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:15:55 user nova-compute[74482]:   </cpu>
Oct 23 23:15:55 user nova-compute[74482]:   <devices>
Oct 23 23:15:55 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:15:55 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:15:55 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk"/>
Oct 23 23:15:55 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:15:55 user nova-compute[74482]:     </disk>
Oct 23 23:15:55 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:15:55 user nova-compute[74482]:       <mac address="fa:16:3e:70:b0:fe"/>
Oct 23 23:15:55 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:15:55 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:15:55 user nova-compute[74482]:       <target dev="tap1f23deed-5e"/>
Oct 23 23:15:55 user nova-compute[74482]:     </interface>
Oct 23 23:15:55 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:15:55 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/console.log" append="off"/>
Oct 23 23:15:55 user nova-compute[74482]:     </serial>
Oct 23 23:15:55 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:15:55 user nova-compute[74482]:     <video>
Oct 23 23:15:55 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:15:55 user nova-compute[74482]:     </video>
Oct 23 23:15:55 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:15:55 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:15:55 user nova-compute[74482]:     </rng>
Oct 23 23:15:55 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:15:55 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:15:55 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:15:55 user nova-compute[74482]:     </memballoon>
Oct 23 23:15:55 user nova-compute[74482]:   </devices>
Oct 23 23:15:55 user nova-compute[74482]: </domain>
Oct 23 23:15:55 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-213171726',display_name='tempest-AttachVolumeTestJSON-server-213171726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-213171726',id=28,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQiBkkPCnvve16LbgMhmUeQ7YP2NPZIWJYitMCOMUuCTlsH9lj5NQWmm7u2keAgnpGzKeCbxM7Rz8bU6gv8GfJBhWF3Px2aXTQZxQyyiMI5j3a1N6rUlmCDf06AiUbSyg==',key_name='tempest-keypair-1365969527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-aw82trdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=d2ea53e4-399b-4b7a-9338-c1c81b3a6253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:b0:fe,bridge_name='br-int',has_traffic_filtering=True,id=1f23deed-5e0c-4e81-858d-9fa8ee97b9f1,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f23deed-5e') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG os_vif [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:b0:fe,bridge_name='br-int',has_traffic_filtering=True,id=1f23deed-5e0c-4e81-858d-9fa8ee97b9f1,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f23deed-5e') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30d0f20f-7566-54e9-8afb-404986e45001', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f23deed-5e, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f23deed-5e, col_values=(('qos', UUID('12a1d5e1-491a-4aae-9a94-e67c9a518c15')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f23deed-5e, col_values=(('external_ids', {'iface-id': '1f23deed-5e0c-4e81-858d-9fa8ee97b9f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:b0:fe', 'vm-uuid': 'd2ea53e4-399b-4b7a-9338-c1c81b3a6253'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:55 user nova-compute[74482]: INFO os_vif [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:b0:fe,bridge_name='br-int',has_traffic_filtering=True,id=1f23deed-5e0c-4e81-858d-9fa8ee97b9f1,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f23deed-5e')
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No VIF found with MAC fa:16:3e:70:b0:fe, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-c9e05e1e-33cd-4934-bab0-c9ca03e58309 req-c144d02c-587c-4179-9fab-f1288995f600 service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Updated VIF entry in instance network info cache for port 1f23deed-5e0c-4e81-858d-9fa8ee97b9f1. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-c9e05e1e-33cd-4934-bab0-c9ca03e58309 req-c144d02c-587c-4179-9fab-f1288995f600 service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Updating instance_info_cache with network_info: [{"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c9e05e1e-33cd-4934-bab0-c9ca03e58309 req-c144d02c-587c-4179-9fab-f1288995f600 service nova] Releasing lock "refresh_cache-d2ea53e4-399b-4b7a-9338-c1c81b3a6253" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:15:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-c2d51fb9-975d-45da-b670-87ef28050095 req-ebe329a8-6f1e-425a-acd0-f1b96d8ec16a service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received event network-vif-plugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c2d51fb9-975d-45da-b670-87ef28050095 req-ebe329a8-6f1e-425a-acd0-f1b96d8ec16a service nova] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c2d51fb9-975d-45da-b670-87ef28050095 req-ebe329a8-6f1e-425a-acd0-f1b96d8ec16a service nova] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c2d51fb9-975d-45da-b670-87ef28050095 req-ebe329a8-6f1e-425a-acd0-f1b96d8ec16a service nova] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-c2d51fb9-975d-45da-b670-87ef28050095 req-ebe329a8-6f1e-425a-acd0-f1b96d8ec16a service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] No waiting events found dispatching network-vif-plugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:15:57 user nova-compute[74482]: WARNING nova.compute.manager [req-c2d51fb9-975d-45da-b670-87ef28050095 req-ebe329a8-6f1e-425a-acd0-f1b96d8ec16a service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received unexpected event network-vif-plugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 for instance with vm_state building and task_state spawning.
Oct 23 23:15:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "95802cf3-56ba-4224-a333-e00e54c72166" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:57 user nova-compute[74482]: INFO nova.compute.manager [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Terminating instance
Oct 23 23:15:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:57 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:15:57 user nova-compute[74482]: INFO nova.compute.claims [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Claim successful on node user
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-dd0ca504-bc7a-4c79-a093-412fa0c91c96 req-6ce72bd7-d30d-481b-9884-7a1cdad4f459 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-unplugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-dd0ca504-bc7a-4c79-a093-412fa0c91c96 req-6ce72bd7-d30d-481b-9884-7a1cdad4f459 service nova] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-dd0ca504-bc7a-4c79-a093-412fa0c91c96 req-6ce72bd7-d30d-481b-9884-7a1cdad4f459 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-dd0ca504-bc7a-4c79-a093-412fa0c91c96 req-6ce72bd7-d30d-481b-9884-7a1cdad4f459 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-dd0ca504-bc7a-4c79-a093-412fa0c91c96 req-6ce72bd7-d30d-481b-9884-7a1cdad4f459 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] No waiting events found dispatching network-vif-unplugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-dd0ca504-bc7a-4c79-a093-412fa0c91c96 req-6ce72bd7-d30d-481b-9884-7a1cdad4f459 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-unplugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Instance destroyed successfully.
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'resources' on Instance uuid 95802cf3-56ba-4224-a333-e00e54c72166 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-441054838',display_name='tempest-ServerRescueNegativeTestJSON-server-441054838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-441054838',id=5,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:01:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-u4d3wnl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:01:11Z,user_data=None,user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=95802cf3-56ba-4224-a333-e00e54c72166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "address": "fa:16:3e:ec:09:58", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd778946c-65", "ovs_interfaceid": "d778946c-6512-4fb7-a247-910aaf4a3ea4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:09:58,bridge_name='br-int',has_traffic_filtering=True,id=d778946c-6512-4fb7-a247-910aaf4a3ea4,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd778946c-65') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG os_vif [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:09:58,bridge_name='br-int',has_traffic_filtering=True,id=d778946c-6512-4fb7-a247-910aaf4a3ea4,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd778946c-65') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd778946c-65, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afb90344-aa55-48fe-be59-025015b7ac8c) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:58 user nova-compute[74482]: INFO os_vif [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:09:58,bridge_name='br-int',has_traffic_filtering=True,id=d778946c-6512-4fb7-a247-910aaf4a3ea4,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd778946c-65')
Oct 23 23:15:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Deleting instance files /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166_del
Oct 23 23:15:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Deletion of /opt/stack/data/nova/instances/95802cf3-56ba-4224-a333-e00e54c72166_del complete
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:15:58 user nova-compute[74482]: INFO nova.compute.manager [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Took 0.79 seconds to destroy the instance on the hypervisor.
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:15:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.policy [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58e1ae75bd484d3ea749e10346671167', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf59ee373fd04ceda1c9212af985f052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:15:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Creating image(s)
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "/opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "/opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "1f01ffe1ccaa317feda4e88ac3ba9718cad23209" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "1f01ffe1ccaa317feda4e88ac3ba9718cad23209" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-c4b4a0d5-e11f-47af-975e-c2d7eb6ea79e req-a8577fe1-e49e-4413-ad8b-c13bda48abac service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received event network-vif-plugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c4b4a0d5-e11f-47af-975e-c2d7eb6ea79e req-a8577fe1-e49e-4413-ad8b-c13bda48abac service nova] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c4b4a0d5-e11f-47af-975e-c2d7eb6ea79e req-a8577fe1-e49e-4413-ad8b-c13bda48abac service nova] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c4b4a0d5-e11f-47af-975e-c2d7eb6ea79e req-a8577fe1-e49e-4413-ad8b-c13bda48abac service nova] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-c4b4a0d5-e11f-47af-975e-c2d7eb6ea79e req-a8577fe1-e49e-4413-ad8b-c13bda48abac service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] No waiting events found dispatching network-vif-plugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:15:59 user nova-compute[74482]: WARNING nova.compute.manager [req-c4b4a0d5-e11f-47af-975e-c2d7eb6ea79e req-a8577fe1-e49e-4413-ad8b-c13bda48abac service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received unexpected event network-vif-plugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 for instance with vm_state building and task_state spawning.
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Successfully created port: adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:15:59 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Took 0.87 seconds to deallocate network for instance.
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.virt.images [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] 956913ee-f8b8-4cb3-892a-d73d322895e3 was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209.part /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:15:59 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Instance spawned successfully.
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:15:59 user nova-compute[74482]: INFO nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Took 6.06 seconds to spawn the instance on the hypervisor.
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209.part /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209.converted" returned: 0 in 0.369s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:59 user nova-compute[74482]: INFO nova.compute.manager [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Took 6.97 seconds to build instance.
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d5308a14-b5e9-40da-854b-5d75c70a92fa tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.074s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "1f01ffe1ccaa317feda4e88ac3ba9718cad23209" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.261s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:15:59 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Successfully updated port: adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquired lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-a36545b6-04fb-4a8e-8d3f-318d0202205a req-df3508a3-aca9-49e9-b0de-cd614972a255 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-a36545b6-04fb-4a8e-8d3f-318d0202205a req-df3508a3-aca9-49e9-b0de-cd614972a255 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing instance network info cache due to event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a36545b6-04fb-4a8e-8d3f-318d0202205a req-df3508a3-aca9-49e9-b0de-cd614972a255 service nova] Acquiring lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:16:00 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Deleted allocations for instance 95802cf3-56ba-4224-a333-e00e54c72166
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209 --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "1f01ffe1ccaa317feda4e88ac3ba9718cad23209" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "1f01ffe1ccaa317feda4e88ac3ba9718cad23209" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fa6a93cc-0bcf-4135-a35b-bd3aba162840 req-ef98acaf-bf9d-4fe2-8dd8-edcf630a5241 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fa6a93cc-0bcf-4135-a35b-bd3aba162840 req-ef98acaf-bf9d-4fe2-8dd8-edcf630a5241 service nova] Acquiring lock "95802cf3-56ba-4224-a333-e00e54c72166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fa6a93cc-0bcf-4135-a35b-bd3aba162840 req-ef98acaf-bf9d-4fe2-8dd8-edcf630a5241 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fa6a93cc-0bcf-4135-a35b-bd3aba162840 req-ef98acaf-bf9d-4fe2-8dd8-edcf630a5241 service nova] Lock "95802cf3-56ba-4224-a333-e00e54c72166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fa6a93cc-0bcf-4135-a35b-bd3aba162840 req-ef98acaf-bf9d-4fe2-8dd8-edcf630a5241 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] No waiting events found dispatching network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:16:00 user nova-compute[74482]: WARNING nova.compute.manager [req-fa6a93cc-0bcf-4135-a35b-bd3aba162840 req-ef98acaf-bf9d-4fe2-8dd8-edcf630a5241 service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received unexpected event network-vif-plugged-d778946c-6512-4fb7-a247-910aaf4a3ea4 for instance with vm_state deleted and task_state None.
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c13e5526-27fa-4606-9365-d2396f53b72c tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "95802cf3-56ba-4224-a333-e00e54c72166" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.531s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209 --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209,backing_fmt=raw /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209,backing_fmt=raw /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk 1073741824" returned: 0 in 0.049s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "1f01ffe1ccaa317feda4e88ac3ba9718cad23209" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209 --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updating instance_info_cache with network_info: [{"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Releasing lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Instance network_info: |[{"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a36545b6-04fb-4a8e-8d3f-318d0202205a req-df3508a3-aca9-49e9-b0de-cd614972a255 service nova] Acquired lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.neutron [req-a36545b6-04fb-4a8e-8d3f-318d0202205a req-df3508a3-aca9-49e9-b0de-cd614972a255 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209 --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Cannot resize image /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Ensure instance console log exists: /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Start _get_guest_xml network_info=[{"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T23:15:55Z,direct_url=<?>,disk_format='qcow2',id=956913ee-f8b8-4cb3-892a-d73d322895e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1266467324',owner='cf59ee373fd04ceda1c9212af985f052',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T23:15:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '956913ee-f8b8-4cb3-892a-d73d322895e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:16:00 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:16:00 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T23:15:55Z,direct_url=<?>,disk_format='qcow2',id=956913ee-f8b8-4cb3-892a-d73d322895e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1266467324',owner='cf59ee373fd04ceda1c9212af985f052',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T23:15:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-439093387',display_name='tempest-TestMinimumBasicScenario-server-439093387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-439093387',id=29,image_ref='956913ee-f8b8-4cb3-892a-d73d322895e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8tKsf7/m4q47tGDK0K6EF5bBRj0v3mbtODFwxcyPLATcfEvIKQYl/sTLS/2pcgUZox2kzh3mX24uqDuLnuMgyHnJrmqivdSRS8QZU28JeKmWWis0WhsrrQ6hE0msjk7w==',key_name='tempest-TestMinimumBasicScenario-1142816068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf59ee373fd04ceda1c9212af985f052',ramdisk_id='',reservation_id='r-pjzv3dhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='956913ee-f8b8-4cb3-892a-d73d322895e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-964628947',owner_user_name='tempest-TestMinimumBasicScenario-964628947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:15:59Z,user_data=None,user_id='58e1ae75bd484d3ea749e10346671167',uuid=fa1823b3-f352-4a42-b287-06b9c8efbd58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converting VIF {"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:b9:b7,bridge_name='br-int',has_traffic_filtering=True,id=adfd802f-80e5-4834-88c9-112cdb39bd3b,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfd802f-80') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.objects.instance [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'pci_devices' on Instance uuid fa1823b3-f352-4a42-b287-06b9c8efbd58 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.neutron [req-a36545b6-04fb-4a8e-8d3f-318d0202205a req-df3508a3-aca9-49e9-b0de-cd614972a255 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updated VIF entry in instance network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.neutron [req-a36545b6-04fb-4a8e-8d3f-318d0202205a req-df3508a3-aca9-49e9-b0de-cd614972a255 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updating instance_info_cache with network_info: [{"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:16:00 user nova-compute[74482]:   <uuid>fa1823b3-f352-4a42-b287-06b9c8efbd58</uuid>
Oct 23 23:16:00 user nova-compute[74482]:   <name>instance-0000001d</name>
Oct 23 23:16:00 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:16:00 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:16:00 user nova-compute[74482]:   <metadata>
Oct 23 23:16:00 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:16:00 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:16:00 user nova-compute[74482]:       <nova:name>tempest-TestMinimumBasicScenario-server-439093387</nova:name>
Oct 23 23:16:00 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:16:00</nova:creationTime>
Oct 23 23:16:00 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:16:00 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:16:00 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:16:00 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:16:00 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:16:00 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:16:00 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:16:00 user nova-compute[74482]:       <nova:owner>
Oct 23 23:16:00 user nova-compute[74482]:         <nova:user uuid="58e1ae75bd484d3ea749e10346671167">tempest-TestMinimumBasicScenario-964628947-project-member</nova:user>
Oct 23 23:16:00 user nova-compute[74482]:         <nova:project uuid="cf59ee373fd04ceda1c9212af985f052">tempest-TestMinimumBasicScenario-964628947</nova:project>
Oct 23 23:16:00 user nova-compute[74482]:       </nova:owner>
Oct 23 23:16:00 user nova-compute[74482]:       <nova:root type="image" uuid="956913ee-f8b8-4cb3-892a-d73d322895e3"/>
Oct 23 23:16:00 user nova-compute[74482]:       <nova:ports>
Oct 23 23:16:00 user nova-compute[74482]:         <nova:port uuid="adfd802f-80e5-4834-88c9-112cdb39bd3b">
Oct 23 23:16:00 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 23:16:00 user nova-compute[74482]:         </nova:port>
Oct 23 23:16:00 user nova-compute[74482]:       </nova:ports>
Oct 23 23:16:00 user nova-compute[74482]:     </nova:instance>
Oct 23 23:16:00 user nova-compute[74482]:   </metadata>
Oct 23 23:16:00 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:16:00 user nova-compute[74482]:     <system>
Oct 23 23:16:00 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:16:00 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:16:00 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:16:00 user nova-compute[74482]:       <entry name="serial">fa1823b3-f352-4a42-b287-06b9c8efbd58</entry>
Oct 23 23:16:00 user nova-compute[74482]:       <entry name="uuid">fa1823b3-f352-4a42-b287-06b9c8efbd58</entry>
Oct 23 23:16:00 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:16:00 user nova-compute[74482]:     </system>
Oct 23 23:16:00 user nova-compute[74482]:   </sysinfo>
Oct 23 23:16:00 user nova-compute[74482]:   <os>
Oct 23 23:16:00 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:16:00 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:16:00 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:16:00 user nova-compute[74482]:   </os>
Oct 23 23:16:00 user nova-compute[74482]:   <features>
Oct 23 23:16:00 user nova-compute[74482]:     <acpi/>
Oct 23 23:16:00 user nova-compute[74482]:     <apic/>
Oct 23 23:16:00 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:16:00 user nova-compute[74482]:   </features>
Oct 23 23:16:00 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:16:00 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:16:00 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:16:00 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:16:00 user nova-compute[74482]:   </clock>
Oct 23 23:16:00 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:16:00 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:16:00 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:16:00 user nova-compute[74482]:   </cpu>
Oct 23 23:16:00 user nova-compute[74482]:   <devices>
Oct 23 23:16:00 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:16:00 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:16:00 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk"/>
Oct 23 23:16:00 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:16:00 user nova-compute[74482]:     </disk>
Oct 23 23:16:00 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:16:00 user nova-compute[74482]:       <mac address="fa:16:3e:22:b9:b7"/>
Oct 23 23:16:00 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:16:00 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:16:00 user nova-compute[74482]:       <target dev="tapadfd802f-80"/>
Oct 23 23:16:00 user nova-compute[74482]:     </interface>
Oct 23 23:16:00 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:16:00 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/console.log" append="off"/>
Oct 23 23:16:00 user nova-compute[74482]:     </serial>
Oct 23 23:16:00 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:16:00 user nova-compute[74482]:     <video>
Oct 23 23:16:00 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:16:00 user nova-compute[74482]:     </video>
Oct 23 23:16:00 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:16:00 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:16:00 user nova-compute[74482]:     </rng>
Oct 23 23:16:00 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:16:00 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:16:00 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:16:00 user nova-compute[74482]:     </memballoon>
Oct 23 23:16:00 user nova-compute[74482]:   </devices>
Oct 23 23:16:00 user nova-compute[74482]: </domain>
Oct 23 23:16:00 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-439093387',display_name='tempest-TestMinimumBasicScenario-server-439093387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-439093387',id=29,image_ref='956913ee-f8b8-4cb3-892a-d73d322895e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8tKsf7/m4q47tGDK0K6EF5bBRj0v3mbtODFwxcyPLATcfEvIKQYl/sTLS/2pcgUZox2kzh3mX24uqDuLnuMgyHnJrmqivdSRS8QZU28JeKmWWis0WhsrrQ6hE0msjk7w==',key_name='tempest-TestMinimumBasicScenario-1142816068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf59ee373fd04ceda1c9212af985f052',ramdisk_id='',reservation_id='r-pjzv3dhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='956913ee-f8b8-4cb3-892a-d73d322895e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-964628947',owner_user_name='tempest-TestMinimumBasicScenario-964628947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:15:59Z,user_data=None,user_id='58e1ae75bd484d3ea749e10346671167',uuid=fa1823b3-f352-4a42-b287-06b9c8efbd58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converting VIF {"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:b9:b7,bridge_name='br-int',has_traffic_filtering=True,id=adfd802f-80e5-4834-88c9-112cdb39bd3b,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfd802f-80') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG os_vif [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b9:b7,bridge_name='br-int',has_traffic_filtering=True,id=adfd802f-80e5-4834-88c9-112cdb39bd3b,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfd802f-80') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a36545b6-04fb-4a8e-8d3f-318d0202205a req-df3508a3-aca9-49e9-b0de-cd614972a255 service nova] Releasing lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab15a492-2c00-5944-bae5-29b57c7261c3', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadfd802f-80, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadfd802f-80, col_values=(('qos', UUID('e3f248f7-7dcc-4d7a-9cac-5a2800056a99')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadfd802f-80, col_values=(('external_ids', {'iface-id': 'adfd802f-80e5-4834-88c9-112cdb39bd3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:b9:b7', 'vm-uuid': 'fa1823b3-f352-4a42-b287-06b9c8efbd58'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:00 user nova-compute[74482]: INFO os_vif [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b9:b7,bridge_name='br-int',has_traffic_filtering=True,id=adfd802f-80e5-4834-88c9-112cdb39bd3b,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfd802f-80')
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:16:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No VIF found with MAC fa:16:3e:22:b9:b7, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:16:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-bc13f606-dfc3-4cf3-abf3-81e46129e622 req-ec5a037d-9475-4484-9365-a0f62e9e7a9e service nova] [instance: 95802cf3-56ba-4224-a333-e00e54c72166] Received event network-vif-deleted-d778946c-6512-4fb7-a247-910aaf4a3ea4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-0e7b9367-c9aa-453d-a326-58cd4f1ad299 req-0bf88b42-fdf3-45bc-ab16-fca49f9ea40c service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0e7b9367-c9aa-453d-a326-58cd4f1ad299 req-0bf88b42-fdf3-45bc-ab16-fca49f9ea40c service nova] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0e7b9367-c9aa-453d-a326-58cd4f1ad299 req-0bf88b42-fdf3-45bc-ab16-fca49f9ea40c service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0e7b9367-c9aa-453d-a326-58cd4f1ad299 req-0bf88b42-fdf3-45bc-ab16-fca49f9ea40c service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-0e7b9367-c9aa-453d-a326-58cd4f1ad299 req-0bf88b42-fdf3-45bc-ab16-fca49f9ea40c service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] No waiting events found dispatching network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:16:02 user nova-compute[74482]: WARNING nova.compute.manager [req-0e7b9367-c9aa-453d-a326-58cd4f1ad299 req-0bf88b42-fdf3-45bc-ab16-fca49f9ea40c service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received unexpected event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b for instance with vm_state building and task_state spawning.
Oct 23 23:16:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-528e59df-6574-4a83-bce5-727b202e3d52 req-48299547-099e-4dac-ba7c-6d0745ff5b66 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-528e59df-6574-4a83-bce5-727b202e3d52 req-48299547-099e-4dac-ba7c-6d0745ff5b66 service nova] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-528e59df-6574-4a83-bce5-727b202e3d52 req-48299547-099e-4dac-ba7c-6d0745ff5b66 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-528e59df-6574-4a83-bce5-727b202e3d52 req-48299547-099e-4dac-ba7c-6d0745ff5b66 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-528e59df-6574-4a83-bce5-727b202e3d52 req-48299547-099e-4dac-ba7c-6d0745ff5b66 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] No waiting events found dispatching network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:16:04 user nova-compute[74482]: WARNING nova.compute.manager [req-528e59df-6574-4a83-bce5-727b202e3d52 req-48299547-099e-4dac-ba7c-6d0745ff5b66 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received unexpected event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b for instance with vm_state building and task_state spawning.
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:16:04 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Instance spawned successfully.
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:16:04 user nova-compute[74482]: INFO nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Took 6.15 seconds to spawn the instance on the hypervisor.
Oct 23 23:16:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:16:04 user nova-compute[74482]: INFO nova.compute.manager [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Took 7.09 seconds to build instance.
Oct 23 23:16:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8265be73-cb0d-4841-a243-c85249bec686 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.218s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:11 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:16:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:16:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:16:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:16:11 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:16:12 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updating instance_info_cache with network_info: [{"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:16:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-c7e4371a-32f9-4156-bea9-b7c4b5df3100" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:16:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:16:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:16:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:16:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "095c2860-554f-4622-902d-8cafda6dbfe9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:18 user nova-compute[74482]: INFO nova.compute.manager [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Terminating instance
Oct 23 23:16:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-8cb14d51-20c2-4130-a3cd-171abae66a09 req-d8aff673-334f-46ac-9a54-688fb1d85906 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-unplugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8cb14d51-20c2-4130-a3cd-171abae66a09 req-d8aff673-334f-46ac-9a54-688fb1d85906 service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8cb14d51-20c2-4130-a3cd-171abae66a09 req-d8aff673-334f-46ac-9a54-688fb1d85906 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8cb14d51-20c2-4130-a3cd-171abae66a09 req-d8aff673-334f-46ac-9a54-688fb1d85906 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-8cb14d51-20c2-4130-a3cd-171abae66a09 req-d8aff673-334f-46ac-9a54-688fb1d85906 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-unplugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-8cb14d51-20c2-4130-a3cd-171abae66a09 req-d8aff673-334f-46ac-9a54-688fb1d85906 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-unplugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Instance destroyed successfully.
Oct 23 23:16:19 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'resources' on Instance uuid 095c2860-554f-4622-902d-8cafda6dbfe9 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1298325207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1298325207',id=24,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:12:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-3l14jumo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:14:33Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=095c2860-554f-4622-902d-8cafda6dbfe9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "9f475537-5a5a-4a04-acf9-d114075b47c2", "address": "fa:16:3e:2e:f4:4b", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f475537-5a", "ovs_interfaceid": "9f475537-5a5a-4a04-acf9-d114075b47c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f4:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f475537-5a5a-4a04-acf9-d114075b47c2,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f475537-5a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_vif [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f4:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f475537-5a5a-4a04-acf9-d114075b47c2,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f475537-5a') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f475537-5a, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52d803cb-b113-4b56-b955-8b291c13926d) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:16:19 user nova-compute[74482]: INFO os_vif [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f4:4b,bridge_name='br-int',has_traffic_filtering=True,id=9f475537-5a5a-4a04-acf9-d114075b47c2,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f475537-5a')
Oct 23 23:16:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkpgPTXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:16:19 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[900f4a50-bf40-435f-8731-1f95cba776df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:16:19 user nova-compute[74482]: No targets found.
Oct 23 23:16:19 user nova-compute[74482]: iSNS:
Oct 23 23:16:19 user nova-compute[74482]: No targets found.
Oct 23 23:16:19 user nova-compute[74482]: STATIC:
Oct 23 23:16:19 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:16:19 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:16:19 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:16:19 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18
Oct 23 23:16:19 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:16:19 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:16:19 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe
Oct 23 23:16:19 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:16:19 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:16:19 user nova-compute[74482]: FIRMWARE:
Oct 23 23:16:19 user nova-compute[74482]: No targets found.
Oct 23 23:16:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:16:19 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:16:19 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[68258ada-5cb3-426b-8945-dcde8cc831a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d66e23-ea95-4bd0-9108-7853c9ecfafd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:16:19 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:16:19 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:16:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 (non-flash)
Oct 23 23:16:19 user nova-compute[74482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:16:19 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:16:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c4a9cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c4a669-81d9-4506-b7be-ecadf2ff15e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb14ae3-3a49-4de8-9bd6-e46d06c5c92b]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[045e64bb-a5ee-4156-b365-7fa5599350f7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd40c7ca-9b0c-4058-9c01-fb38e4349089]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23632623064343039', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2faf6521', '/dev/disk/by-id/scsi-1SCST_BIO2faf6521-62b0d409d893de7a') {{(pid=86306) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d731df-1afd-45de-b931-0c31a4c5efdd]: (4, None) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4b4a67-1ce7-4ee6-93c8-6e5cd0f2386f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a5ef1a-4a48-4b2e-a5a7-724b9b13ca2b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18, portal: 172.16.0.220,3260]
Oct 23 23:16:19 user nova-compute[74482]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18, portal: 172.16.0.220,3260] successful.
Oct 23 23:16:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f404ac-63d4-4371-98ad-8de4f7c82d18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1637b4f-8796-4aa0-9c36-d8bde260aaf8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] <== disconnect_volume: return (315ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:16:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Deleting instance files /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9_del
Oct 23 23:16:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Deletion of /opt/stack/data/nova/instances/095c2860-554f-4622-902d-8cafda6dbfe9_del complete
Oct 23 23:16:19 user nova-compute[74482]: INFO nova.compute.manager [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:16:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:16:20 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:16:20 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Took 0.52 seconds to deallocate network for instance.
Oct 23 23:16:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-07848d73-65da-4d6b-a31a-ab43f6c823ea req-c60e9901-5c2c-4072-9049-80c548ca0254 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-deleted-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-a1ee4813-e013-4372-acd7-b45de3b90524 req-45bbbce1-3252-4bac-a1c7-0da5f39b2992 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a1ee4813-e013-4372-acd7-b45de3b90524 req-45bbbce1-3252-4bac-a1c7-0da5f39b2992 service nova] Acquiring lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a1ee4813-e013-4372-acd7-b45de3b90524 req-45bbbce1-3252-4bac-a1c7-0da5f39b2992 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a1ee4813-e013-4372-acd7-b45de3b90524 req-45bbbce1-3252-4bac-a1c7-0da5f39b2992 service nova] Lock "095c2860-554f-4622-902d-8cafda6dbfe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-a1ee4813-e013-4372-acd7-b45de3b90524 req-45bbbce1-3252-4bac-a1c7-0da5f39b2992 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] No waiting events found dispatching network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:16:20 user nova-compute[74482]: WARNING nova.compute.manager [req-a1ee4813-e013-4372-acd7-b45de3b90524 req-45bbbce1-3252-4bac-a1c7-0da5f39b2992 service nova] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Received unexpected event network-vif-plugged-9f475537-5a5a-4a04-acf9-d114075b47c2 for instance with vm_state active and task_state deleting.
Oct 23 23:16:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:16:20 user nova-compute[74482]: INFO nova.compute.manager [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: 095c2860-554f-4622-902d-8cafda6dbfe9] Took 0.78 seconds to detach 1 volumes for instance.
Oct 23 23:16:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:21 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:16:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:16:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:21 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Deleted allocations for instance 095c2860-554f-4622-902d-8cafda6dbfe9
Oct 23 23:16:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c9d9c85f-0bc3-4b51-b965-3da17714ca45 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "095c2860-554f-4622-902d-8cafda6dbfe9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.023s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:16:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:16:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:16:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:16:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:16:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:16:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:16:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:16:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:16:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=7679MB free_disk=24.866683959960938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:16:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance a18c958b-f7d9-47ba-ad98-332e12838d81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7b69955-1715-4185-8926-12b46b32227d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 127d7315-74d4-4905-b203-67556d26e3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fa1823b3-f352-4a42-b287-06b9c8efbd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:48 user nova-compute[74482]: INFO nova.compute.manager [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Terminating instance
Oct 23 23:16:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-3fb224ad-c98c-4341-bd94-4e1f5927c2c8 req-bab129e2-2d7e-4934-a71a-d9c081f1e52e service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-unplugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3fb224ad-c98c-4341-bd94-4e1f5927c2c8 req-bab129e2-2d7e-4934-a71a-d9c081f1e52e service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3fb224ad-c98c-4341-bd94-4e1f5927c2c8 req-bab129e2-2d7e-4934-a71a-d9c081f1e52e service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3fb224ad-c98c-4341-bd94-4e1f5927c2c8 req-bab129e2-2d7e-4934-a71a-d9c081f1e52e service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-3fb224ad-c98c-4341-bd94-4e1f5927c2c8 req-bab129e2-2d7e-4934-a71a-d9c081f1e52e service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-unplugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-3fb224ad-c98c-4341-bd94-4e1f5927c2c8 req-bab129e2-2d7e-4934-a71a-d9c081f1e52e service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-unplugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Instance destroyed successfully.
Oct 23 23:16:48 user nova-compute[74482]: DEBUG nova.objects.instance [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lazy-loading 'resources' on Instance uuid 2c51493a-92fc-4297-9ba9-8ee2770c8eb0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-906590860',display_name='tempest-ServerRescueNegativeTestJSON-server-906590860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-906590860',id=4,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c07328e2befa472d804361a59ac16829',ramdisk_id='',reservation_id='r-q5yfdo5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1888569284',owner_user_name='tempest-ServerRescueNegativeTestJSON-1888569284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:06:01Z,user_data=None,user_id='2dfe9260c1b8446fbcda07a9dcfa65fb',uuid=2c51493a-92fc-4297-9ba9-8ee2770c8eb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converting VIF {"id": "26004c78-273a-4649-818c-2cd38fd8bcbc", "address": "fa:16:3e:08:ee:5b", "network": {"id": "0e3c5a85-8e48-4941-9044-a46378220cf1", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-651532312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c07328e2befa472d804361a59ac16829", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26004c78-27", "ovs_interfaceid": "26004c78-273a-4649-818c-2cd38fd8bcbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:ee:5b,bridge_name='br-int',has_traffic_filtering=True,id=26004c78-273a-4649-818c-2cd38fd8bcbc,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26004c78-27') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG os_vif [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:ee:5b,bridge_name='br-int',has_traffic_filtering=True,id=26004c78-273a-4649-818c-2cd38fd8bcbc,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26004c78-27') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26004c78-27, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fd99231-5ac3-4ea9-94c5-961594512f5c) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:48 user nova-compute[74482]: INFO os_vif [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:ee:5b,bridge_name='br-int',has_traffic_filtering=True,id=26004c78-273a-4649-818c-2cd38fd8bcbc,network=Network(0e3c5a85-8e48-4941-9044-a46378220cf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26004c78-27')
Oct 23 23:16:48 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Deleting instance files /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0_del
Oct 23 23:16:48 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Deletion of /opt/stack/data/nova/instances/2c51493a-92fc-4297-9ba9-8ee2770c8eb0_del complete
Oct 23 23:16:49 user nova-compute[74482]: INFO nova.compute.manager [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 23 23:16:49 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:16:49 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:16:49 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:16:49 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:16:49 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Took 0.40 seconds to deallocate network for instance.
Oct 23 23:16:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-f123e550-6d81-49e7-a563-ba584eee580e req-51218785-b5df-495d-b8f1-3d4526b225d1 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-deleted-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:49 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:16:49 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:16:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:49 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Deleted allocations for instance 2c51493a-92fc-4297-9ba9-8ee2770c8eb0
Oct 23 23:16:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-073ecdf8-cd32-4abc-9f10-3de0486e01fa tempest-ServerRescueNegativeTestJSON-1888569284 tempest-ServerRescueNegativeTestJSON-1888569284-project-member] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.621s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-cad1d30f-37bf-4ba2-bf48-af22acfd1afd req-2652f236-dc14-48a0-acc0-d0eb01a44180 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cad1d30f-37bf-4ba2-bf48-af22acfd1afd req-2652f236-dc14-48a0-acc0-d0eb01a44180 service nova] Acquiring lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:16:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cad1d30f-37bf-4ba2-bf48-af22acfd1afd req-2652f236-dc14-48a0-acc0-d0eb01a44180 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:16:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cad1d30f-37bf-4ba2-bf48-af22acfd1afd req-2652f236-dc14-48a0-acc0-d0eb01a44180 service nova] Lock "2c51493a-92fc-4297-9ba9-8ee2770c8eb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:16:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-cad1d30f-37bf-4ba2-bf48-af22acfd1afd req-2652f236-dc14-48a0-acc0-d0eb01a44180 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] No waiting events found dispatching network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:16:50 user nova-compute[74482]: WARNING nova.compute.manager [req-cad1d30f-37bf-4ba2-bf48-af22acfd1afd req-2652f236-dc14-48a0-acc0-d0eb01a44180 service nova] [instance: 2c51493a-92fc-4297-9ba9-8ee2770c8eb0] Received unexpected event network-vif-plugged-26004c78-273a-4649-818c-2cd38fd8bcbc for instance with vm_state deleted and task_state None.
Oct 23 23:16:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-98557952-3d3a-4996-9d4d-9a6cecc30f4f req-243a3375-fb5b-40fe-bd7a-0940ac60528f service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received event network-changed-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:16:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-98557952-3d3a-4996-9d4d-9a6cecc30f4f req-243a3375-fb5b-40fe-bd7a-0940ac60528f service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Refreshing instance network info cache due to event network-changed-fa4e5017-0b5a-4b46-b88b-35253303446c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:16:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-98557952-3d3a-4996-9d4d-9a6cecc30f4f req-243a3375-fb5b-40fe-bd7a-0940ac60528f service nova] Acquiring lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:16:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-98557952-3d3a-4996-9d4d-9a6cecc30f4f req-243a3375-fb5b-40fe-bd7a-0940ac60528f service nova] Acquired lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:16:53 user nova-compute[74482]: DEBUG nova.network.neutron [req-98557952-3d3a-4996-9d4d-9a6cecc30f4f req-243a3375-fb5b-40fe-bd7a-0940ac60528f service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Refreshing network info cache for port fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:16:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:54 user nova-compute[74482]: DEBUG nova.network.neutron [req-98557952-3d3a-4996-9d4d-9a6cecc30f4f req-243a3375-fb5b-40fe-bd7a-0940ac60528f service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updated VIF entry in instance network info cache for port fa4e5017-0b5a-4b46-b88b-35253303446c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:16:54 user nova-compute[74482]: DEBUG nova.network.neutron [req-98557952-3d3a-4996-9d4d-9a6cecc30f4f req-243a3375-fb5b-40fe-bd7a-0940ac60528f service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating instance_info_cache with network_info: [{"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:16:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-98557952-3d3a-4996-9d4d-9a6cecc30f4f req-243a3375-fb5b-40fe-bd7a-0940ac60528f service nova] Releasing lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:16:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:16:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG nova.objects.instance [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:00 user nova-compute[74482]: INFO nova.compute.manager [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attaching volume 2dca6106-ee7e-487a-a45d-319f9bd1b96d to /dev/vdb
Oct 23 23:17:00 user nova-compute[74482]: DEBUG os_brick.utils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92c1f10-9aa8-463b-9b31-788151a5c35a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e8e926-a440-4a3b-a58d-3144e423efda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790e202-69b6-40f1-8823-ec0af1a3d29a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96232cae-2720-4531-a86c-0df36de3d548]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:00 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:17:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9215821-7822-4560-a6c2-9fc5ef4dc88f]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG os_brick.utils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:17:00 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating existing volume attachment record: 0486e46a-13f4-4a3f-b515-2860d3efc170 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:17:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:09 user nova-compute[74482]: INFO nova.compute.manager [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Terminating instance
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-53204660-3fe8-43b4-948a-cb577617c4fd req-0d245339-e732-4341-b4a2-142fc5185b26 service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-unplugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-53204660-3fe8-43b4-948a-cb577617c4fd req-0d245339-e732-4341-b4a2-142fc5185b26 service nova] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-53204660-3fe8-43b4-948a-cb577617c4fd req-0d245339-e732-4341-b4a2-142fc5185b26 service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-53204660-3fe8-43b4-948a-cb577617c4fd req-0d245339-e732-4341-b4a2-142fc5185b26 service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-53204660-3fe8-43b4-948a-cb577617c4fd req-0d245339-e732-4341-b4a2-142fc5185b26 service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] No waiting events found dispatching network-vif-unplugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-53204660-3fe8-43b4-948a-cb577617c4fd req-0d245339-e732-4341-b4a2-142fc5185b26 service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-unplugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Instance destroyed successfully.
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.objects.instance [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'resources' on Instance uuid a18c958b-f7d9-47ba-ad98-332e12838d81 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:07:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1398952637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1398952637',id=18,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:07:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-ddzzzov1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:09:43Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=a18c958b-f7d9-47ba-ad98-332e12838d81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "address": "fa:16:3e:b1:14:ea", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d311a7-9a", "ovs_interfaceid": "e9d311a7-9a4f-439c-ace1-ed6ac41bd86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:14:ea,bridge_name='br-int',has_traffic_filtering=True,id=e9d311a7-9a4f-439c-ace1-ed6ac41bd86d,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d311a7-9a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG os_vif [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:14:ea,bridge_name='br-int',has_traffic_filtering=True,id=e9d311a7-9a4f-439c-ace1-ed6ac41bd86d,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d311a7-9a') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9d311a7-9a, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f52644a7-f560-41d1-9de2-8b45e1bd9d46) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: INFO os_vif [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:14:ea,bridge_name='br-int',has_traffic_filtering=True,id=e9d311a7-9a4f-439c-ace1-ed6ac41bd86d,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d311a7-9a')
Oct 23 23:17:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Deleting instance files /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81_del
Oct 23 23:17:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Deletion of /opt/stack/data/nova/instances/a18c958b-f7d9-47ba-ad98-332e12838d81_del complete
Oct 23 23:17:09 user nova-compute[74482]: INFO nova.compute.manager [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 23 23:17:09 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:10 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:10 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Took 0.73 seconds to deallocate network for instance.
Oct 23 23:17:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:10 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:17:10 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:11 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Deleted allocations for instance a18c958b-f7d9-47ba-ad98-332e12838d81
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-045e971f-89d0-4b12-bd2e-1a6048baa6a4 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] No waiting events found dispatching network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:17:11 user nova-compute[74482]: WARNING nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received unexpected event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d for instance with vm_state deleted and task_state None.
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] No waiting events found dispatching network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:17:11 user nova-compute[74482]: WARNING nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received unexpected event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d for instance with vm_state deleted and task_state None.
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] No waiting events found dispatching network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:17:11 user nova-compute[74482]: WARNING nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received unexpected event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d for instance with vm_state deleted and task_state None.
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-unplugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] No waiting events found dispatching network-vif-unplugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:17:11 user nova-compute[74482]: WARNING nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received unexpected event network-vif-unplugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d for instance with vm_state deleted and task_state None.
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-deleted-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Acquiring lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] Lock "a18c958b-f7d9-47ba-ad98-332e12838d81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] No waiting events found dispatching network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:17:11 user nova-compute[74482]: WARNING nova.compute.manager [req-1a19b557-5041-4c33-967d-2720ca2f9b3f req-d40462be-8529-4401-9f1c-03ca51b680ab service nova] [instance: a18c958b-f7d9-47ba-ad98-332e12838d81] Received unexpected event network-vif-plugged-e9d311a7-9a4f-439c-ace1-ed6ac41bd86d for instance with vm_state deleted and task_state None.
Oct 23 23:17:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcTwlUdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:17:17 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:17:17 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:17:17 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f63a01-e7da-4516-8610-39a3935a4a39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:17:17 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e0215-6ee5-48ef-8872-77d729b9a5d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d] added
Oct 23 23:17:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0e18b3-76c4-422c-9cbb-54b5f55c959b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93691c8-1280-43c9-8c6b-a009258e6e00]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcTwlUdA {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcTwlUdA" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdec526-a880-4c12-b1a7-521c77220e70]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zcTwlUdA'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce032eb-fa5b-4e13-8a75-8ac4a0224af4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2899d2-7008-4d81-ac0e-f2856ca9a23c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:17:17 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:17:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:17:17 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:17:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[24953955-146c-4f7d-8319-648ee096c29f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d, portal: 172.16.0.220,3260]
Oct 23 23:17:17 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d, portal: 172.16.0.220,3260] successful.
Oct 23 23:17:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b82b347-b37a-4941-aebd-cb49b9a7d069]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f119fa82-cd0e-4b36-a0ea-1eb9970cf2e4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:17:17 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:17:17 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:17:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:17:17 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:17:17 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:17:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab42563-1893-4be5-a832-77f2cebb4862]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:17:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcTwlUdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updating instance_info_cache with network_info: [{"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-aa28db49-fd2f-4d64-96c3-4c14d805a37a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23839393738346333', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839393738346333', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG nova.objects.instance [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:17:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:17:18 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:17:18 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:17:18 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:17:18 user nova-compute[74482]:   <serial>2dca6106-ee7e-487a-a45d-319f9bd1b96d</serial>
Oct 23 23:17:18 user nova-compute[74482]: </disk>
Oct 23 23:17:18 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:17:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:17:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:17:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No VIF found with MAC fa:16:3e:f8:5e:d4, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:17:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2ba17cf7-8b46-4a0b-9310-10c4fbde9d70 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.704s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:17:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:26 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:17:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:17:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:29 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:17:29 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8097MB free_disk=25.01544952392578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa28db49-fd2f-4d64-96c3-4c14d805a37a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7b69955-1715-4185-8926-12b46b32227d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 127d7315-74d4-4905-b203-67556d26e3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fa1823b3-f352-4a42-b287-06b9c8efbd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:33 user nova-compute[74482]: INFO nova.compute.manager [None req-47b09174-9f4a-4d7e-b93d-0af074a8e5d7 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Get console output
Oct 23 23:17:33 user nova-compute[74482]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 23 23:17:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:17:36 user nova-compute[74482]: INFO nova.compute.claims [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Claim successful on node user
Oct 23 23:17:36 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:17:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:17:36 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:17:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:17:37 user nova-compute[74482]: INFO nova.virt.block_device [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Booting with volume 7de9737f-2bc6-4cfe-96e9-2c4e76171b85 at /dev/vda
Oct 23 23:17:37 user nova-compute[74482]: DEBUG nova.policy [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5dcb591df7446e5b904895723688502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4563c2e2ad42fa9cb3880a8b628f66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG os_brick.utils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842669d-e05c-4076-9863-27304889f320]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[661061e3-3910-40b0-b2c3-72f5285946bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c25a54-ce55-4b91-b552-633b49653861]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20a3cb4-dabc-4f77-b8b7-cfbedcbc045f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:37 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:17:37 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7245ec-b0a7-48b9-a32c-5139fcf6f11a]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG os_brick.utils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating existing volume attachment record: 1d465edc-962a-426b-a565-7d329f56244e {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:17:37 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully created port: 6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:17:38 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully created port: dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:17:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:39 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully created port: f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:17:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully created port: 3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:17:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully created port: 5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully updated port: 6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-185bea69-2ab7-4057-8024-da1d68c6c0b1 req-7fb45bd6-1da8-4fdd-a0f3-aba967fb3fd9 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-changed-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-185bea69-2ab7-4057-8024-da1d68c6c0b1 req-7fb45bd6-1da8-4fdd-a0f3-aba967fb3fd9 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing instance network info cache due to event network-changed-6c38883d-5612-4b06-928e-e6119b34020b. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-185bea69-2ab7-4057-8024-da1d68c6c0b1 req-7fb45bd6-1da8-4fdd-a0f3-aba967fb3fd9 service nova] Acquiring lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-185bea69-2ab7-4057-8024-da1d68c6c0b1 req-7fb45bd6-1da8-4fdd-a0f3-aba967fb3fd9 service nova] Acquired lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-185bea69-2ab7-4057-8024-da1d68c6c0b1 req-7fb45bd6-1da8-4fdd-a0f3-aba967fb3fd9 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing network info cache for port 6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-185bea69-2ab7-4057-8024-da1d68c6c0b1 req-7fb45bd6-1da8-4fdd-a0f3-aba967fb3fd9 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-185bea69-2ab7-4057-8024-da1d68c6c0b1 req-7fb45bd6-1da8-4fdd-a0f3-aba967fb3fd9 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-185bea69-2ab7-4057-8024-da1d68c6c0b1 req-7fb45bd6-1da8-4fdd-a0f3-aba967fb3fd9 service nova] Releasing lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully updated port: ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:17:42 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully updated port: fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-changed-ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing instance network info cache due to event network-changed-ede33686-8b6e-46d2-ae50-1c7ecb791d7e. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] Acquiring lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] Acquired lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing network info cache for port ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully updated port: dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] Releasing lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-changed-fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing instance network info cache due to event network-changed-fb533230-30d2-4006-adf8-60c66ab60fab. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] Acquiring lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] Acquired lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing network info cache for port fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-2af3486f-b013-4c23-8c81-dd0463d1652e req-11345ebd-4bee-4029-bfe5-26c65a74923c service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received event network-changed-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-2af3486f-b013-4c23-8c81-dd0463d1652e req-11345ebd-4bee-4029-bfe5-26c65a74923c service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Refreshing instance network info cache due to event network-changed-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2af3486f-b013-4c23-8c81-dd0463d1652e req-11345ebd-4bee-4029-bfe5-26c65a74923c service nova] Acquiring lock "refresh_cache-d2ea53e4-399b-4b7a-9338-c1c81b3a6253" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2af3486f-b013-4c23-8c81-dd0463d1652e req-11345ebd-4bee-4029-bfe5-26c65a74923c service nova] Acquired lock "refresh_cache-d2ea53e4-399b-4b7a-9338-c1c81b3a6253" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-2af3486f-b013-4c23-8c81-dd0463d1652e req-11345ebd-4bee-4029-bfe5-26c65a74923c service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Refreshing network info cache for port 1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG nova.network.neutron [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-861778cb-0f71-4073-b9d3-9b7f511af3e8 req-a334b9da-1d95-411b-8aeb-bf4b788420f3 service nova] Releasing lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:44 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully updated port: f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:17:44 user nova-compute[74482]: DEBUG nova.network.neutron [req-2af3486f-b013-4c23-8c81-dd0463d1652e req-11345ebd-4bee-4029-bfe5-26c65a74923c service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Updated VIF entry in instance network info cache for port 1f23deed-5e0c-4e81-858d-9fa8ee97b9f1. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:17:44 user nova-compute[74482]: DEBUG nova.network.neutron [req-2af3486f-b013-4c23-8c81-dd0463d1652e req-11345ebd-4bee-4029-bfe5-26c65a74923c service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Updating instance_info_cache with network_info: [{"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2af3486f-b013-4c23-8c81-dd0463d1652e req-11345ebd-4bee-4029-bfe5-26c65a74923c service nova] Releasing lock "refresh_cache-d2ea53e4-399b-4b7a-9338-c1c81b3a6253" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:44 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully updated port: 3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-changed-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing instance network info cache due to event network-changed-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] Acquiring lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] Acquired lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing network info cache for port dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Successfully updated port: 5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] Releasing lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-changed-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing instance network info cache due to event network-changed-f88eff13-8f21-42b1-ac4f-6976acf42ed7. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] Acquiring lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] Acquired lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing network info cache for port f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] Releasing lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-changed-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing instance network info cache due to event network-changed-3607096f-a4dc-4f09-9be4-857c5f4cd6bd. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] Acquiring lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] Acquired lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing network info cache for port 3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:17:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:17:46 user nova-compute[74482]: DEBUG nova.network.neutron [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-59e63ce5-b2ae-4c70-8c9e-0a70d2614500 req-322760e1-8e7a-4f91-a189-6ecb497ace35 service nova] Releasing lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquired lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:46 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:17:46 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:17:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-40e0b88d-78f8-457f-8c1b-f73d4f25c501 req-23fc50b1-fc00-4ec3-83b2-1c08715a262c service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-changed-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:17:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-40e0b88d-78f8-457f-8c1b-f73d4f25c501 req-23fc50b1-fc00-4ec3-83b2-1c08715a262c service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing instance network info cache due to event network-changed-5d77bd19-daa8-4658-94f3-b53ae5852c39. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:17:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-40e0b88d-78f8-457f-8c1b-f73d4f25c501 req-23fc50b1-fc00-4ec3-83b2-1c08715a262c service nova] Acquiring lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:17:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [{"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Releasing lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance network_info: |[{"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:17:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-40e0b88d-78f8-457f-8c1b-f73d4f25c501 req-23fc50b1-fc00-4ec3-83b2-1c08715a262c service nova] Acquired lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:17:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-40e0b88d-78f8-457f-8c1b-f73d4f25c501 req-23fc50b1-fc00-4ec3-83b2-1c08715a262c service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing network info cache for port 5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:17:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-40e0b88d-78f8-457f-8c1b-f73d4f25c501 req-23fc50b1-fc00-4ec3-83b2-1c08715a262c service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updated VIF entry in instance network info cache for port 5d77bd19-daa8-4658-94f3-b53ae5852c39. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:17:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-40e0b88d-78f8-457f-8c1b-f73d4f25c501 req-23fc50b1-fc00-4ec3-83b2-1c08715a262c service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [{"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:17:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-40e0b88d-78f8-457f-8c1b-f73d4f25c501 req-23fc50b1-fc00-4ec3-83b2-1c08715a262c service nova] Releasing lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:17:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:49 user nova-compute[74482]: DEBUG nova.objects.instance [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:17:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:50 user nova-compute[74482]: INFO nova.compute.manager [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Attaching volume c73f8739-efba-47fc-abcf-b65a9499e4aa to /dev/vdb
Oct 23 23:17:50 user nova-compute[74482]: DEBUG os_brick.utils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49c58ad-d32d-4b1b-afbf-4657f82d4179]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2f2a23-680e-4e2e-8b27-ee319fcf77c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4847550c-e91d-42f5-b989-49c54c229b72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f36dfc-a7b6-4177-82c7-c8ef2d856ca4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:50 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:17:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6815ffe8-a171-4e14-b90f-480eda0b54f9]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG os_brick.utils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:17:50 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Updating existing volume attachment record: b96495cf-722f-435b-8d86-b6d0007c36c8 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:17:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:53 user nova-compute[74482]: INFO nova.compute.manager [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Detaching volume 2dca6106-ee7e-487a-a45d-319f9bd1b96d
Oct 23 23:17:53 user nova-compute[74482]: INFO nova.virt.block_device [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attempting to driver detach volume 2dca6106-ee7e-487a-a45d-319f9bd1b96d from mountpoint /dev/vdb
Oct 23 23:17:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Attempting to detach device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:17:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:17:53 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:17:53 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:17:53 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:17:53 user nova-compute[74482]:   <serial>2dca6106-ee7e-487a-a45d-319f9bd1b96d</serial>
Oct 23 23:17:53 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:17:53 user nova-compute[74482]: </disk>
Oct 23 23:17:53 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:17:53 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully detached device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the persistent domain config.
Oct 23 23:17:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:17:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:17:53 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:17:53 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:17:53 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:17:53 user nova-compute[74482]:   <serial>2dca6106-ee7e-487a-a45d-319f9bd1b96d</serial>
Oct 23 23:17:53 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:17:53 user nova-compute[74482]: </disk>
Oct 23 23:17:53 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:17:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:17:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:53 user nova-compute[74482]: DEBUG nova.objects.instance [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'flavor' on Instance uuid fa1823b3-f352-4a42-b287-06b9c8efbd58 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:17:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:54 user nova-compute[74482]: INFO nova.compute.manager [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Attaching volume e83539a8-e374-4e24-8a5e-489c0e158011 to /dev/vdb
Oct 23 23:17:54 user nova-compute[74482]: DEBUG os_brick.utils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b70e8a-822c-45ab-843b-6581595b6b97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[201fc26e-ccc4-4b2e-853c-3bccdc1f2eaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab4f614-00ef-4dda-999a-15a274606817]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d78f89-b371-4425-8d57-aea28bd3889a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:54 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:17:54 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc61f6fd-7b22-40a5-995a-5b013c2cc18c]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG os_brick.utils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updating existing volume attachment record: 99e4e8da-37ca-42f8-8c77-a692b7178293 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:17:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:56 user nova-compute[74482]: INFO nova.virt.block_device [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Booting with volume 68617071-77df-4687-a814-6cf81c1ced9f at /dev/vdb
Oct 23 23:17:56 user nova-compute[74482]: DEBUG os_brick.utils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:17:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7cb305-b23e-40d4-8baa-4b61bef19c3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d75daea-687b-4a43-bfb5-5279d7d7d071]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebfda4e-8795-4757-9c15-64226deaf49a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b257bd7a-1968-4627-aca1-08d3ce10a55f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:17:57 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:17:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0531646c-f431-4677-a2d4-eb3d5b5f4637]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG os_brick.utils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:17:57 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating existing volume attachment record: fdcc753f-28bd-489f-9718-4a9aa8dbbc81 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:17:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:17:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:17:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:17:59 user nova-compute[74482]: INFO nova.compute.manager [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Terminating instance
Oct 23 23:17:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:17:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:17:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-8f680229-7674-4921-a369-72af57991286 req-f1a7572b-39aa-499d-a98b-689c50921aa8 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-unplugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8f680229-7674-4921-a369-72af57991286 req-f1a7572b-39aa-499d-a98b-689c50921aa8 service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8f680229-7674-4921-a369-72af57991286 req-f1a7572b-39aa-499d-a98b-689c50921aa8 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8f680229-7674-4921-a369-72af57991286 req-f1a7572b-39aa-499d-a98b-689c50921aa8 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-8f680229-7674-4921-a369-72af57991286 req-f1a7572b-39aa-499d-a98b-689c50921aa8 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-unplugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-8f680229-7674-4921-a369-72af57991286 req-f1a7572b-39aa-499d-a98b-689c50921aa8 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-unplugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Instance destroyed successfully.
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'resources' on Instance uuid aa28db49-fd2f-4d64-96c3-4c14d805a37a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:02:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-943860777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-943860777',id=11,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-20n6qgib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:06:01Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=aa28db49-fd2f-4d64-96c3-4c14d805a37a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "address": "fa:16:3e:5a:7c:fa", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ca04dd6-98", "ovs_interfaceid": "9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:7c:fa,bridge_name='br-int',has_traffic_filtering=True,id=9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca04dd6-98') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_vif [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:7c:fa,bridge_name='br-int',has_traffic_filtering=True,id=9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca04dd6-98') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ca04dd6-98, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=005f092a-7cea-4049-aa55-540a9eea7ad5) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:00 user nova-compute[74482]: INFO os_vif [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:7c:fa,bridge_name='br-int',has_traffic_filtering=True,id=9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ca04dd6-98')
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPKYvIin', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:00 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[461434c8-a330-498c-a6f5-a2c0be295147]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:18:00 user nova-compute[74482]: No targets found.
Oct 23 23:18:00 user nova-compute[74482]: iSNS:
Oct 23 23:18:00 user nova-compute[74482]: No targets found.
Oct 23 23:18:00 user nova-compute[74482]: STATIC:
Oct 23 23:18:00 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446
Oct 23 23:18:00 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:00 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:00 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d
Oct 23 23:18:00 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:00 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:00 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe
Oct 23 23:18:00 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:00 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:00 user nova-compute[74482]: FIRMWARE:
Oct 23 23:18:00 user nova-compute[74482]: No targets found.
Oct 23 23:18:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:18:00 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:18:00 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5c3e0c-56cb-4536-9e9a-21c319487c12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5523880-27a6-48b8-9f8b-eb32c400ae9d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:00 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:00 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:18:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:00 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:00 user nova-compute[74482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 (non-flash)
Oct 23 23:18:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308f9d3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446'): ({'sdc'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Removing single pathed devices sdc {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77c471a-341d-44b4-b849-f1d6da7c8e3f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b26bcf-f019-4ac4-a6f4-168155b5d2ba]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Flushing IO for device /dev/sdc {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[597e8b56-2ed3-4132-956c-8953e0693cd2]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d31e2d1-8d34-4e26-b9a7-4b9b54af7a9a]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de5744b-83e9-492a-8c13-1a56fa668af0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e0da86-8248-4b9a-b12f-1759be028527]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446, portal: 172.16.0.220,3260]
Oct 23 23:18:00 user nova-compute[74482]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446, portal: 172.16.0.220,3260] successful.
Oct 23 23:18:00 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c9cff8-3189-4532-9d6d-bb7236e4d446 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e92b94-9fcb-4cb0-9432-e3eeac6c2621]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] <== disconnect_volume: return (317ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:18:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Deleting instance files /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a_del
Oct 23 23:18:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Deletion of /opt/stack/data/nova/instances/aa28db49-fd2f-4d64-96c3-4c14d805a37a_del complete
Oct 23 23:18:00 user nova-compute[74482]: INFO nova.compute.manager [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 23 23:18:00 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:18:00 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:18:01 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:18:01 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Took 0.59 seconds to deallocate network for instance.
Oct 23 23:18:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d5c90c0-18b6-410c-acb0-f15182f26fd9 req-3a441145-f05e-49b6-af52-14aa3cac4cd8 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-deleted-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-d1617796-5ff4-49af-b9de-c3df78192709 req-e31ec557-d6b0-43cb-8dfc-d28e6dbf5013 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d1617796-5ff4-49af-b9de-c3df78192709 req-e31ec557-d6b0-43cb-8dfc-d28e6dbf5013 service nova] Acquiring lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d1617796-5ff4-49af-b9de-c3df78192709 req-e31ec557-d6b0-43cb-8dfc-d28e6dbf5013 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d1617796-5ff4-49af-b9de-c3df78192709 req-e31ec557-d6b0-43cb-8dfc-d28e6dbf5013 service nova] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-d1617796-5ff4-49af-b9de-c3df78192709 req-e31ec557-d6b0-43cb-8dfc-d28e6dbf5013 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] No waiting events found dispatching network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:02 user nova-compute[74482]: WARNING nova.compute.manager [req-d1617796-5ff4-49af-b9de-c3df78192709 req-e31ec557-d6b0-43cb-8dfc-d28e6dbf5013 service nova] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Received unexpected event network-vif-plugged-9ca04dd6-98ab-4027-90f7-2dfb6ba9aca8 for instance with vm_state active and task_state deleting.
Oct 23 23:18:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChjmyfJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:08 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:08 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:08 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e101b8-1c83-4be3-b41a-4348eb09d7f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:18:08 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[285ac0e9-8c43-4fcc-ac1d-9f2e806c7a90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa] added
Oct 23 23:18:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[477b90b5-c9eb-4ed6-b67f-733135847094]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6b7d1-623e-49fa-944c-331f2c51b3f4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChjmyfJl {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChjmyfJl" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1ab016-62aa-4317-a626-50637b688de0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ChjmyfJl'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[814ff9f5-3452-4d92-8ff2-5b424910ca01]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fbfa5c-c35b-405a-8ca9-30147639fe5d]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:08 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:08 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dc939e-4776-45b1-95d3-fce59ace3365]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa, portal: 172.16.0.220,3260]
Oct 23 23:18:08 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa, portal: 172.16.0.220,3260] successful.
Oct 23 23:18:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[79060543-03d5-40ef-8d44-a493f7b496a9]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf82eb8-7117-4fbe-adbe-b93917fa85d4]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:09 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:09 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:09 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:09 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:09 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:09 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4e75cd-020a-4f5c-ba68-89b42ffbe4b6]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChjmyfJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:18:09 user nova-compute[74482]: INFO nova.compute.manager [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: aa28db49-fd2f-4d64-96c3-4c14d805a37a] Took 8.13 seconds to detach 1 volumes for instance.
Oct 23 23:18:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:09 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23639383261353366', 'path': '/dev/sdc'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639383261353366', 'path': '/dev/sdc'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG nova.objects.instance [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:18:10 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:18:10 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:18:10 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:18:10 user nova-compute[74482]:   <serial>c73f8739-efba-47fc-abcf-b65a9499e4aa</serial>
Oct 23 23:18:10 user nova-compute[74482]: </disk>
Oct 23 23:18:10 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:18:10 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Deleted allocations for instance aa28db49-fd2f-4d64-96c3-4c14d805a37a
Oct 23 23:18:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c59ec7bd-91e5-4bd5-9038-b58314c01c6e tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "aa28db49-fd2f-4d64-96c3-4c14d805a37a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.488s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No VIF found with MAC fa:16:3e:70:b0:fe, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:18:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b4204160-1d46-4a9f-8f88-24fea32be62b tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.652s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hczUobex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:13 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:13 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:13 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c589918c-4f83-4c79-8df7-244f7b8044fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:18:13 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b272ca-51ff-4c7d-847e-933f3b91de52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011] added
Oct 23 23:18:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08a48d4-d26e-4ce7-a82c-fb182e589a73]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e9286d-5d56-4afd-8f02-05451b50f5c8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hczUobex {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hczUobex" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b867ed-26c1-4faf-bd29-e45ee06a5c98]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hczUobex'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba351100-4fba-4f28-a586-7c2e224452b7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f970bd-4444-4282-9545-6cda9104aab1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bbaa06-780f-44cc-94a4-3be17af6bedd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011, portal: 172.16.0.220,3260]
Oct 23 23:18:13 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011, portal: 172.16.0.220,3260] successful.
Oct 23 23:18:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[043f7890-ce65-4f9a-9950-d83deecf75fe]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1334a94e-cd4a-44bf-96be-bf9759b7594c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:13 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:13 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 127d7315-74d4-4905-b203-67556d26e3c3 is timed out.
Oct 23 23:18:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully detached device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the live domain config.
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7934baa2-0004-4c86-8d56-05cfd31ad767]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcTwlUdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:13 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hczUobex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23438623264393464', 'path': '/dev/sde'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438623264393464', 'path': '/dev/sde'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'flavor' on Instance uuid fa1823b3-f352-4a42-b287-06b9c8efbd58 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb0e1a9-4d72-4b3d-8ee4-9e86edf6594f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:18:14 user nova-compute[74482]: No targets found.
Oct 23 23:18:14 user nova-compute[74482]: iSNS:
Oct 23 23:18:14 user nova-compute[74482]: No targets found.
Oct 23 23:18:14 user nova-compute[74482]: STATIC:
Oct 23 23:18:14 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa
Oct 23 23:18:14 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:14 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:14 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:18:14 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:14 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:14 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d
Oct 23 23:18:14 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:14 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:14 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe
Oct 23 23:18:14 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:14 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:14 user nova-compute[74482]: FIRMWARE:
Oct 23 23:18:14 user nova-compute[74482]: No targets found.
Oct 23 23:18:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:18:14 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:18:14 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:18:14 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:18:14 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:18:14 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:18:14 user nova-compute[74482]:   <serial>e83539a8-e374-4e24-8a5e-489c0e158011</serial>
Oct 23 23:18:14 user nova-compute[74482]: </disk>
Oct 23 23:18:14 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b988d-9e33-489e-92e3-67905abab7c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8105d1b0-3f81-4352-b1ff-e764ec1347fb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:14 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:14 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:14 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:14 user nova-compute[74482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d (non-flash)
Oct 23 23:18:14 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:14 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c442440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6662c951-6b5a-43a9-a5e3-00deb175a370]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fc0722-9276-483d-ac00-636d3ff407b5]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d01d2-2eb5-498e-ae1a-814da1bfdfa4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c9e96-a662-49df-90e6-b4fdb460b685]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c90be2-db2c-4720-91d3-c12984896b19]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[573d3083-c547-4e8d-bad3-431a286456c2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d, portal: 172.16.0.220,3260]
Oct 23 23:18:14 user nova-compute[74482]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d, portal: 172.16.0.220,3260] successful.
Oct 23 23:18:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dca6106-ee7e-487a-a45d-319f9bd1b96d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d282a89-13ef-415c-8f96-a0061486a987]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== disconnect_volume: return (1366ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:18:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:18:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:18:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] No VIF found with MAC fa:16:3e:22:b9:b7, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:18:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-db1d957b-19c8-4dd4-a79e-ac18b58dc83d tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.101s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:15 user nova-compute[74482]: DEBUG nova.objects.instance [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5dcc21c8-8191-437c-b4b9-34c918259408 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.898s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:16 user nova-compute[74482]: INFO nova.virt.block_device [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Booting with volume f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 at /dev/vdc
Oct 23 23:18:16 user nova-compute[74482]: DEBUG os_brick.utils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3eb68d-ca78-402a-a5f1-3c0dd598108e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c00cc7-02d1-46db-a4a1-06bca4fabb97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d987fea6-38c2-471e-8d97-69c725a49513]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c541f027-7607-4520-97c8-a15613b22be6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:18:16 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61e41cd-1d3b-435b-a85e-867fb9c1db1e]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG os_brick.utils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating existing volume attachment record: b0566b93-43c7-4a0a-beed-a39750a1cf46 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:18:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7b69955-1715-4185-8926-12b46b32227d] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating instance_info_cache with network_info: [{"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-c7b69955-1715-4185-8926-12b46b32227d" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG nova.objects.instance [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-48c76ca4-d40b-4422-8177-5884e0a747d5 req-0723a339-3ce1-4983-9101-03187908d9f5 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-48c76ca4-d40b-4422-8177-5884e0a747d5 req-0723a339-3ce1-4983-9101-03187908d9f5 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing instance network info cache due to event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-48c76ca4-d40b-4422-8177-5884e0a747d5 req-0723a339-3ce1-4983-9101-03187908d9f5 service nova] Acquiring lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-48c76ca4-d40b-4422-8177-5884e0a747d5 req-0723a339-3ce1-4983-9101-03187908d9f5 service nova] Acquired lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG nova.network.neutron [req-48c76ca4-d40b-4422-8177-5884e0a747d5 req-0723a339-3ce1-4983-9101-03187908d9f5 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:17 user nova-compute[74482]: INFO nova.compute.manager [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Attaching volume cb1266e9-fa29-43cc-b377-b090fdecf334 to /dev/vdc
Oct 23 23:18:17 user nova-compute[74482]: DEBUG os_brick.utils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fea92d5-339b-4475-9b61-e30813add5d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c78b96-839c-41a1-80fd-0a4471cb4b0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf6fb2a-76f0-4b76-abf8-b114e99c2ae4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[66462077-b88b-46c8-956f-ca238e2ee13e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:18:17 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:18:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d94e2e-1c84-4c01-8651-ab46bf414ae8]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG os_brick.utils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:17 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Updating existing volume attachment record: 02dd434e-5a28-4d24-b7f7-e975cfdaf22f {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:18:18 user nova-compute[74482]: DEBUG nova.network.neutron [req-48c76ca4-d40b-4422-8177-5884e0a747d5 req-0723a339-3ce1-4983-9101-03187908d9f5 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updated VIF entry in instance network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:18:18 user nova-compute[74482]: DEBUG nova.network.neutron [req-48c76ca4-d40b-4422-8177-5884e0a747d5 req-0723a339-3ce1-4983-9101-03187908d9f5 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updating instance_info_cache with network_info: [{"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:18:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-48c76ca4-d40b-4422-8177-5884e0a747d5 req-0723a339-3ce1-4983-9101-03187908d9f5 service nova] Releasing lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:18:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:18:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-cfdd4a6a-8d4c-4d4c-90ba-098b506dad93 req-db62fc85-ef35-4650-886b-df676fc17d71 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-cfdd4a6a-8d4c-4d4c-90ba-098b506dad93 req-db62fc85-ef35-4650-886b-df676fc17d71 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing instance network info cache due to event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cfdd4a6a-8d4c-4d4c-90ba-098b506dad93 req-db62fc85-ef35-4650-886b-df676fc17d71 service nova] Acquiring lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cfdd4a6a-8d4c-4d4c-90ba-098b506dad93 req-db62fc85-ef35-4650-886b-df676fc17d71 service nova] Acquired lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-cfdd4a6a-8d4c-4d4c-90ba-098b506dad93 req-db62fc85-ef35-4650-886b-df676fc17d71 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-cfdd4a6a-8d4c-4d4c-90ba-098b506dad93 req-db62fc85-ef35-4650-886b-df676fc17d71 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updated VIF entry in instance network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-cfdd4a6a-8d4c-4d4c-90ba-098b506dad93 req-db62fc85-ef35-4650-886b-df676fc17d71 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updating instance_info_cache with network_info: [{"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cfdd4a6a-8d4c-4d4c-90ba-098b506dad93 req-db62fc85-ef35-4650-886b-df676fc17d71 service nova] Releasing lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:20 user nova-compute[74482]: INFO nova.compute.manager [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Rebooting instance
Oct 23 23:18:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquired lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:18:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:18:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updating instance_info_cache with network_info: [{"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:18:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Releasing lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:18:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:18:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-4def3780-9615-472e-a533-f2c90d90a998 req-da2a0a8f-8afb-4e88-bd96-2ae4a206f662 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-unplugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4def3780-9615-472e-a533-f2c90d90a998 req-da2a0a8f-8afb-4e88-bd96-2ae4a206f662 service nova] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4def3780-9615-472e-a533-f2c90d90a998 req-da2a0a8f-8afb-4e88-bd96-2ae4a206f662 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4def3780-9615-472e-a533-f2c90d90a998 req-da2a0a8f-8afb-4e88-bd96-2ae4a206f662 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-4def3780-9615-472e-a533-f2c90d90a998 req-da2a0a8f-8afb-4e88-bd96-2ae4a206f662 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] No waiting events found dispatching network-vif-unplugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:23 user nova-compute[74482]: WARNING nova.compute.manager [req-4def3780-9615-472e-a533-f2c90d90a998 req-da2a0a8f-8afb-4e88-bd96-2ae4a206f662 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received unexpected event network-vif-unplugged-adfd802f-80e5-4834-88c9-112cdb39bd3b for instance with vm_state active and task_state reboot_started.
Oct 23 23:18:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Instance shutdown successfully.
Oct 23 23:18:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-6d226a84-34df-4993-b005-6760009d585b req-b13f9c71-d4c5-4b9c-ab79-b03d93aab4bc service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6d226a84-34df-4993-b005-6760009d585b req-b13f9c71-d4c5-4b9c-ab79-b03d93aab4bc service nova] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6d226a84-34df-4993-b005-6760009d585b req-b13f9c71-d4c5-4b9c-ab79-b03d93aab4bc service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6d226a84-34df-4993-b005-6760009d585b req-b13f9c71-d4c5-4b9c-ab79-b03d93aab4bc service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-6d226a84-34df-4993-b005-6760009d585b req-b13f9c71-d4c5-4b9c-ab79-b03d93aab4bc service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] No waiting events found dispatching network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:25 user nova-compute[74482]: WARNING nova.compute.manager [req-6d226a84-34df-4993-b005-6760009d585b req-b13f9c71-d4c5-4b9c-ab79-b03d93aab4bc service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received unexpected event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b for instance with vm_state active and task_state reboot_started.
Oct 23 23:18:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] No waiting events found dispatching network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:27 user nova-compute[74482]: WARNING nova.compute.manager [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received unexpected event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b for instance with vm_state active and task_state reboot_started.
Oct 23 23:18:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] No waiting events found dispatching network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:27 user nova-compute[74482]: WARNING nova.compute.manager [req-2a012bc6-b073-43bd-b489-5f81adf964c1 req-49f3c75c-adaa-4326-ad1e-083cd1da0ee2 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received unexpected event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b for instance with vm_state active and task_state reboot_started.
Oct 23 23:18:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Instance running successfully.
Oct 23 23:18:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Instance soft rebooted successfully.
Oct 23 23:18:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8efd8155-3bf6-4643-92a9-26da14d80fa4 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.569s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:18:30 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:18:30 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8238MB free_disk=25.002124786376953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fc2566c6-8911-425b-b05d-a008e67a9d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7b69955-1715-4185-8926-12b46b32227d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 127d7315-74d4-4905-b203-67556d26e3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fa1823b3-f352-4a42-b287-06b9c8efbd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 9f06ae6e-bd11-437e-817c-e245be9afdae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:34 user nova-compute[74482]: INFO nova.compute.manager [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Terminating instance
Oct 23 23:18:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-83d76a6b-6a57-4a98-8979-2b61ec0edbae req-49f51656-d0dd-4b1f-881b-62e63ab1fd57 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-unplugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83d76a6b-6a57-4a98-8979-2b61ec0edbae req-49f51656-d0dd-4b1f-881b-62e63ab1fd57 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83d76a6b-6a57-4a98-8979-2b61ec0edbae req-49f51656-d0dd-4b1f-881b-62e63ab1fd57 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83d76a6b-6a57-4a98-8979-2b61ec0edbae req-49f51656-d0dd-4b1f-881b-62e63ab1fd57 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-83d76a6b-6a57-4a98-8979-2b61ec0edbae req-49f51656-d0dd-4b1f-881b-62e63ab1fd57 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-unplugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-83d76a6b-6a57-4a98-8979-2b61ec0edbae req-49f51656-d0dd-4b1f-881b-62e63ab1fd57 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-unplugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: c7b69955-1715-4185-8926-12b46b32227d] Instance destroyed successfully.
Oct 23 23:18:34 user nova-compute[74482]: DEBUG nova.objects.instance [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'resources' on Instance uuid c7b69955-1715-4185-8926-12b46b32227d {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1502585542',display_name='tempest-ServerActionsTestOtherA-server-1502585542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1502585542',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIFqjOSyUZWQsU5gFsbXrBOoj4Cp26qpoZb6ZuADPp+mJaMBG92ILD46Qtgf0LpXdVLgOqmH/QEGrVpFM/l9sAP2h6k2MXu+chElwiN2sa7paHBVT+RCfDr3O/3kW7sqg==',key_name='tempest-keypair-1686845388',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-8rr9kvp1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=c7b69955-1715-4185-8926-12b46b32227d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "address": "fa:16:3e:96:ad:04", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff82f9a6-5f", "ovs_interfaceid": "ff82f9a6-5f42-4e98-b4df-93bbfb502665", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG os_vif [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff82f9a6-5f, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c649cb8-d610-4bfa-a0bc-ead806fe7d12) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:35 user nova-compute[74482]: INFO os_vif [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:ad:04,bridge_name='br-int',has_traffic_filtering=True,id=ff82f9a6-5f42-4e98-b4df-93bbfb502665,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff82f9a6-5f')
Oct 23 23:18:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikLSfjBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:35 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9e1059-2678-4c9d-9bf5-6f6edea8f672]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:18:35 user nova-compute[74482]: No targets found.
Oct 23 23:18:35 user nova-compute[74482]: iSNS:
Oct 23 23:18:35 user nova-compute[74482]: No targets found.
Oct 23 23:18:35 user nova-compute[74482]: STATIC:
Oct 23 23:18:35 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa
Oct 23 23:18:35 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:35 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:35 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:18:35 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:35 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:35 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe
Oct 23 23:18:35 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:18:35 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:18:35 user nova-compute[74482]: FIRMWARE:
Oct 23 23:18:35 user nova-compute[74482]: No targets found.
Oct 23 23:18:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:18:35 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:18:35 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7ca188-a085-453e-8b70-120886faeca9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f3deff-8ca6-47ff-ab3a-d7aca2fd7338]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:35 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:35 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe (non-flash)
Oct 23 23:18:35 user nova-compute[74482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:35 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c635090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe'): ({'sdd'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Removing single pathed devices sdd {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbe8530-5bbb-45b6-8eba-ddedf770bfc6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd01ec-b9a5-45ea-9ad0-f97b46f92a42]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Flushing IO for device /dev/sdd {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b88d70b-7392-4750-bb83-18e0e560b05a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b78c3c-aaa5-4104-bda5-2a1aacb5eafb]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_14a32821', '/dev/disk/by-id/scsi-1SCST_BIO14a32821-84190084870da926', '/dev/disk/by-id/scsi-23834313930303834') {{(pid=86306) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[676f72d3-841c-450b-be28-6ecec6bac8e5]: (4, None) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[025b1b89-7fcf-46c6-b7c7-b11f873a7a99]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7c3296-c7b5-4a40-be08-3c6330fcfb09]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260]
Oct 23 23:18:35 user nova-compute[74482]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe, portal: 172.16.0.220,3260] successful.
Oct 23 23:18:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc22b3b7-f89b-4f40-9210-727055244fbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee75eccd-f793-44fd-8ea5-bdcb97e33bd6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] <== disconnect_volume: return (410ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:18:35 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Deleting instance files /opt/stack/data/nova/instances/c7b69955-1715-4185-8926-12b46b32227d_del
Oct 23 23:18:35 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Deletion of /opt/stack/data/nova/instances/c7b69955-1715-4185-8926-12b46b32227d_del complete
Oct 23 23:18:35 user nova-compute[74482]: INFO nova.compute.manager [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Took 1.46 seconds to destroy the instance on the hypervisor.
Oct 23 23:18:35 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: c7b69955-1715-4185-8926-12b46b32227d] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: c7b69955-1715-4185-8926-12b46b32227d] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:18:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: c7b69955-1715-4185-8926-12b46b32227d] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:18:36 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: c7b69955-1715-4185-8926-12b46b32227d] Took 0.80 seconds to deallocate network for instance.
Oct 23 23:18:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:18:36 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Creating image(s)
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Ensure instance console log exists: /opt/stack/data/nova/instances/9f06ae6e-bd11-437e-817c-e245be9afdae/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Start _get_guest_xml network_info=[{"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNhRAUBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f06ae6e-bd11-437e-817c-e245be9afdae', 'attached_at': '', 'detached_at': '', 'volume_id': '7de9737f-2bc6-4cfe-96e9-2c4e76171b85', 'serial': '7de9737f-2bc6-4cfe-96e9-2c4e76171b85'}, 'disk_bus': 'virtio', 'attachment_id': '1d465edc-962a-426b-a565-7d329f56244e', 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqwNohUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f06ae6e-bd11-437e-817c-e245be9afdae', 'attached_at': '', 'detached_at': '', 'volume_id': '68617071-77df-4687-a814-6cf81c1ced9f', 'serial': '68617071-77df-4687-a814-6cf81c1ced9f'}, 'disk_bus': 'virtio', 'attachment_id': 'fdcc753f-28bd-489f-9718-4a9aa8dbbc81', 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecQfsazK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f06ae6e-bd11-437e-817c-e245be9afdae', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3fcec09-6620-4f7e-9ce1-87f3fdbcc338', 'serial': 'f3fcec09-6620-4f7e-9ce1-87f3fdbcc338'}, 'disk_bus': 'virtio', 'attachment_id': 'b0566b93-43c7-4a0a-beed-a39750a1cf46', 'boot_index': 2, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:18:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:18:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNhRAUBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:36 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:36 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:36 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:36 user nova-compute[74482]: WARNING nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state active and task_state deleting.
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:36 user nova-compute[74482]: WARNING nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state active and task_state deleting.
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:36 user nova-compute[74482]: WARNING nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state active and task_state deleting.
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-unplugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-unplugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-unplugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Acquiring lock "c7b69955-1715-4185-8926-12b46b32227d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] Lock "c7b69955-1715-4185-8926-12b46b32227d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] No waiting events found dispatching network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:36 user nova-compute[74482]: WARNING nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received unexpected event network-vif-plugged-ff82f9a6-5f42-4e98-b4df-93bbfb502665 for instance with vm_state active and task_state deleting.
Oct 23 23:18:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-71fa5b58-b856-40b9-8284-f1b4f2b1f72a req-f2109015-b37b-4446-bbcb-7b1516c50d49 service nova] [instance: c7b69955-1715-4185-8926-12b46b32227d] Received event network-vif-deleted-ff82f9a6-5f42-4e98-b4df-93bbfb502665 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ad92a3-2a21-4a03-ba25-765c4e517ed3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:18:36 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[48560fc8-1c5c-4d9b-8e95-09a5bba38b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85] added
Oct 23 23:18:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a76699-41e5-4715-aab3-fc8bf393e245]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e628390-f1c5-463f-a4cb-9a676919da4c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNhRAUBx {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNhRAUBx" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[480ae9c7-0eaf-42e1-a0f2-3b77773e71ca]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PNhRAUBx'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fde5217-229c-497f-baa4-6b1283d143bc]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[144be9c5-7cac-4c02-b8a6-6de39a9deded]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:36 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:36 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ccabd9-bdaf-4283-a016-5adb1b9b11c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85, portal: 172.16.0.220,3260]
Oct 23 23:18:36 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85, portal: 172.16.0.220,3260] successful.
Oct 23 23:18:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ecf40b-0a5e-4fcf-b2c4-bdae4dcce087]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac9d5aa-2069-4fd8-80e1-5e329826b7b2]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:36 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:36 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:36 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:36 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0075b933-ec2c-41e4-a454-ccccb9a69bad]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:18:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNhRAUBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:18:37 user nova-compute[74482]: INFO nova.compute.manager [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Took 0.89 seconds to detach 1 volumes for instance.
Oct 23 23:18:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7b69955-1715-4185-8926-12b46b32227d] Deleting volume: bc22b3b7-f89b-4f40-9210-727055244fbe {{(pid=74482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:37 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Deleted allocations for instance c7b69955-1715-4185-8926-12b46b32227d
Oct 23 23:18:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-968c6ce7-c6a6-4672-a4b0-7e82ad834a83 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7b69955-1715-4185-8926-12b46b32227d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.861s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23766616534613936', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766616534613936', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqwNohUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:37 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:37 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:37 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:37 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:18:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae8c4de-9494-4a26-a174-4d6e4a3e1057]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:18:38 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[625350f1-7bd7-46d3-b7d0-4d8b17c57f2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f] added
Oct 23 23:18:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cccca00-21c2-4e0f-adb1-c9ed179f218c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82ce841-942d-494f-b8b3-75d9feb617b5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FqwNohUB {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FqwNohUB" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e6faf-67e9-4ee5-af31-6e85f265d0e3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FqwNohUB'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cdfc52-6e4c-4171-a7aa-52bc0d73246e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[369180b6-c417-4ce9-b96a-ad050b5ca369]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3383c89-ee5c-4377-a18c-9ce6e543de46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f, portal: 172.16.0.220,3260]
Oct 23 23:18:38 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f, portal: 172.16.0.220,3260] successful.
Oct 23 23:18:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea22e8fe-430e-4a29-88f9-115b2b80ed30]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[567c7c43-f1d8-42a8-81eb-a6e039580706]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:38 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[77202748-b695-45f1-aea7-04e417b48e24]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqwNohUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlOISpzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:38 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '23936626363663662', 'path': '/dev/sdd'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936626363663662', 'path': '/dev/sdd'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.542s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:39 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:39 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c650cc89-c27d-4908-85e3-e9ea8a81c0c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:18:39 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecQfsazK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:39 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[323e334b-cc37-4cbe-8206-cc7670f84c4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334] added
Oct 23 23:18:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bb3b25-5055-44e5-bfe1-9e0faa5b312f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa807e-208c-4003-8035-67438e30547f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nlOISpzo {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nlOISpzo" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1d24aa-ec51-4d33-967f-c0a10a1c1874]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nlOISpzo'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a1d006-6e28-433e-ae01-1c875fa92412]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[668a6ee8-f5b8-4d9f-9f7e-73a1b8e37678]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[061bd8a1-0d4b-42ff-8b89-a669297a2884]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334, portal: 172.16.0.220,3260]
Oct 23 23:18:39 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334, portal: 172.16.0.220,3260] successful.
Oct 23 23:18:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a749ad2-82e7-4e6e-9540-dc61533e8126]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa422a6b-3850-4564-9108-b0fe1d77ce40]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:39 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:18:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39a1edd-440f-4719-b3df-c308ed41ffdd]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:18:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlOISpzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== connect_volume: return (1943ms) {'type': 'block', 'scsi_wwn': '23334343337306639', 'path': '/dev/sdf'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334343337306639', 'path': '/dev/sdf'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.367s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:40 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:18:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:18:40 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG nova.objects.instance [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[95616f48-7ba1-4156-81c2-27b433dacd9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:18:40 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:18:40 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:18:40 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:18:40 user nova-compute[74482]:   <target dev="vdc" bus="virtio"/>
Oct 23 23:18:40 user nova-compute[74482]:   <serial>cb1266e9-fa29-43cc-b377-b090fdecf334</serial>
Oct 23 23:18:40 user nova-compute[74482]: </disk>
Oct 23 23:18:40 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a2be8f-be38-41a8-abd2-e5e0cf4d2e89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338] added
Oct 23 23:18:40 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0657c-311b-4c5a-9502-548668df94fa]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.047s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[752d39e7-8f75-4509-b59c-5f62b4ef67bf]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecQfsazK {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecQfsazK" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40d42c2-1ef6-46d3-b544-44e4df926b96]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ecQfsazK'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7448be2b-75fb-432d-a19a-861516f4908e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0c2796-e379-4f7e-b8c5-b3f716ed80db]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e8a97e-76ed-49bc-b146-5897e8798f11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338, portal: 172.16.0.220,3260]
Oct 23 23:18:41 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338, portal: 172.16.0.220,3260] successful.
Oct 23 23:18:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[609bcf77-3277-41ac-b230-9c3e7ff6efcd]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20a11a8-9bd3-48e4-a113-051a24a1c4e0]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:18:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a7562f-9273-4863-b8a7-7df9e9b30b50]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecQfsazK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] No VIF found with MAC fa:16:3e:70:b0:fe, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:18:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-03c77492-d3bb-438a-83c1-65f40f399d69 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.953s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] <== connect_volume: return (2795ms) {'type': 'block', 'scsi_wwn': '23163393464663739', 'path': '/dev/sdg'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163393464663739', 'path': '/dev/sdg'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b2:c0,bridge_name='br-int',has_traffic_filtering=True,id=6c38883d-5612-4b06-928e-e6119b34020b,network=Network(d892f962-1c0f-4d13-8e64-d6eca45ae04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c38883d-56') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:2b:0a,bridge_name='br-int',has_traffic_filtering=True,id=ede33686-8b6e-46d2-ae50-1c7ecb791d7e,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapede33686-8b') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:a2:af,bridge_name='br-int',has_traffic_filtering=True,id=fb533230-30d2-4006-adf8-60c66ab60fab,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb533230-30') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:10:ab,bridge_name='br-int',has_traffic_filtering=True,id=dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec80ea9-e4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d6,bridge_name='br-int',has_traffic_filtering=True,id=f88eff13-8f21-42b1-ac4f-6976acf42ed7,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88eff13-8f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:47,bridge_name='br-int',has_traffic_filtering=True,id=3607096f-a4dc-4f09-9be4-857c5f4cd6bd,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3607096f-a4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:27:88,bridge_name='br-int',has_traffic_filtering=True,id=5d77bd19-daa8-4658-94f3-b53ae5852c39,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77bd19-da') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.objects.instance [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f06ae6e-bd11-437e-817c-e245be9afdae {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:18:42 user nova-compute[74482]:   <uuid>9f06ae6e-bd11-437e-817c-e245be9afdae</uuid>
Oct 23 23:18:42 user nova-compute[74482]:   <name>instance-0000001e</name>
Oct 23 23:18:42 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:18:42 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:18:42 user nova-compute[74482]:   <metadata>
Oct 23 23:18:42 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:18:42 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:18:42 user nova-compute[74482]:       <nova:name>tempest-device-tagging-server-340781614</nova:name>
Oct 23 23:18:42 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:18:36</nova:creationTime>
Oct 23 23:18:42 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:18:42 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:18:42 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:18:42 user nova-compute[74482]:       <nova:owner>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:user uuid="d5dcb591df7446e5b904895723688502">tempest-TaggedBootDevicesTest-925962805-project-member</nova:user>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:project uuid="7f4563c2e2ad42fa9cb3880a8b628f66">tempest-TaggedBootDevicesTest-925962805</nova:project>
Oct 23 23:18:42 user nova-compute[74482]:       </nova:owner>
Oct 23 23:18:42 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:18:42 user nova-compute[74482]:       <nova:ports>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:port uuid="6c38883d-5612-4b06-928e-e6119b34020b">
Oct 23 23:18:42 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 23:18:42 user nova-compute[74482]:         </nova:port>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:port uuid="ede33686-8b6e-46d2-ae50-1c7ecb791d7e">
Oct 23 23:18:42 user nova-compute[74482]:           <nova:ip type="fixed" address="10.1.1.253" ipVersion="4"/>
Oct 23 23:18:42 user nova-compute[74482]:         </nova:port>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:port uuid="fb533230-30d2-4006-adf8-60c66ab60fab">
Oct 23 23:18:42 user nova-compute[74482]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Oct 23 23:18:42 user nova-compute[74482]:         </nova:port>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:port uuid="dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3">
Oct 23 23:18:42 user nova-compute[74482]:           <nova:ip type="fixed" address="10.1.1.214" ipVersion="4"/>
Oct 23 23:18:42 user nova-compute[74482]:         </nova:port>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:port uuid="f88eff13-8f21-42b1-ac4f-6976acf42ed7">
Oct 23 23:18:42 user nova-compute[74482]:           <nova:ip type="fixed" address="10.1.1.225" ipVersion="4"/>
Oct 23 23:18:42 user nova-compute[74482]:         </nova:port>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:port uuid="3607096f-a4dc-4f09-9be4-857c5f4cd6bd">
Oct 23 23:18:42 user nova-compute[74482]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 23 23:18:42 user nova-compute[74482]:         </nova:port>
Oct 23 23:18:42 user nova-compute[74482]:         <nova:port uuid="5d77bd19-daa8-4658-94f3-b53ae5852c39">
Oct 23 23:18:42 user nova-compute[74482]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 23 23:18:42 user nova-compute[74482]:         </nova:port>
Oct 23 23:18:42 user nova-compute[74482]:       </nova:ports>
Oct 23 23:18:42 user nova-compute[74482]:     </nova:instance>
Oct 23 23:18:42 user nova-compute[74482]:   </metadata>
Oct 23 23:18:42 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:18:42 user nova-compute[74482]:     <system>
Oct 23 23:18:42 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:18:42 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:18:42 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:18:42 user nova-compute[74482]:       <entry name="serial">9f06ae6e-bd11-437e-817c-e245be9afdae</entry>
Oct 23 23:18:42 user nova-compute[74482]:       <entry name="uuid">9f06ae6e-bd11-437e-817c-e245be9afdae</entry>
Oct 23 23:18:42 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:18:42 user nova-compute[74482]:     </system>
Oct 23 23:18:42 user nova-compute[74482]:   </sysinfo>
Oct 23 23:18:42 user nova-compute[74482]:   <os>
Oct 23 23:18:42 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:18:42 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:18:42 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:18:42 user nova-compute[74482]:   </os>
Oct 23 23:18:42 user nova-compute[74482]:   <features>
Oct 23 23:18:42 user nova-compute[74482]:     <acpi/>
Oct 23 23:18:42 user nova-compute[74482]:     <apic/>
Oct 23 23:18:42 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:18:42 user nova-compute[74482]:   </features>
Oct 23 23:18:42 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:18:42 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:18:42 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:18:42 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:18:42 user nova-compute[74482]:   </clock>
Oct 23 23:18:42 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:18:42 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:18:42 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:18:42 user nova-compute[74482]:   </cpu>
Oct 23 23:18:42 user nova-compute[74482]:   <devices>
Oct 23 23:18:42 user nova-compute[74482]:     <disk type="file" device="cdrom">
Oct 23 23:18:42 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 23:18:42 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/9f06ae6e-bd11-437e-817c-e245be9afdae/disk.config"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="hda" bus="ide"/>
Oct 23 23:18:42 user nova-compute[74482]:     </disk>
Oct 23 23:18:42 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:18:42 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:18:42 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <serial>7de9737f-2bc6-4cfe-96e9-2c4e76171b85</serial>
Oct 23 23:18:42 user nova-compute[74482]:     </disk>
Oct 23 23:18:42 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:18:42 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:18:42 user nova-compute[74482]:       <source dev="/dev/sdd"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="vdb" bus="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <serial>68617071-77df-4687-a814-6cf81c1ced9f</serial>
Oct 23 23:18:42 user nova-compute[74482]:     </disk>
Oct 23 23:18:42 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:18:42 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:18:42 user nova-compute[74482]:       <source dev="/dev/sdg"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="vdc" bus="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <serial>f3fcec09-6620-4f7e-9ce1-87f3fdbcc338</serial>
Oct 23 23:18:42 user nova-compute[74482]:     </disk>
Oct 23 23:18:42 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:18:42 user nova-compute[74482]:       <mac address="fa:16:3e:92:b2:c0"/>
Oct 23 23:18:42 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="tap6c38883d-56"/>
Oct 23 23:18:42 user nova-compute[74482]:     </interface>
Oct 23 23:18:42 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:18:42 user nova-compute[74482]:       <mac address="fa:16:3e:32:2b:0a"/>
Oct 23 23:18:42 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="tapede33686-8b"/>
Oct 23 23:18:42 user nova-compute[74482]:     </interface>
Oct 23 23:18:42 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:18:42 user nova-compute[74482]:       <mac address="fa:16:3e:48:a2:af"/>
Oct 23 23:18:42 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="tapfb533230-30"/>
Oct 23 23:18:42 user nova-compute[74482]:     </interface>
Oct 23 23:18:42 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:18:42 user nova-compute[74482]:       <mac address="fa:16:3e:cd:10:ab"/>
Oct 23 23:18:42 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="tapdec80ea9-e4"/>
Oct 23 23:18:42 user nova-compute[74482]:     </interface>
Oct 23 23:18:42 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:18:42 user nova-compute[74482]:       <mac address="fa:16:3e:b1:88:d6"/>
Oct 23 23:18:42 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="tapf88eff13-8f"/>
Oct 23 23:18:42 user nova-compute[74482]:     </interface>
Oct 23 23:18:42 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:18:42 user nova-compute[74482]:       <mac address="fa:16:3e:7d:e4:47"/>
Oct 23 23:18:42 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="tap3607096f-a4"/>
Oct 23 23:18:42 user nova-compute[74482]:     </interface>
Oct 23 23:18:42 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:18:42 user nova-compute[74482]:       <mac address="fa:16:3e:14:27:88"/>
Oct 23 23:18:42 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:18:42 user nova-compute[74482]:       <target dev="tap5d77bd19-da"/>
Oct 23 23:18:42 user nova-compute[74482]:     </interface>
Oct 23 23:18:42 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:18:42 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/9f06ae6e-bd11-437e-817c-e245be9afdae/console.log" append="off"/>
Oct 23 23:18:42 user nova-compute[74482]:     </serial>
Oct 23 23:18:42 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:18:42 user nova-compute[74482]:     <video>
Oct 23 23:18:42 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:18:42 user nova-compute[74482]:     </video>
Oct 23 23:18:42 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:18:42 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:18:42 user nova-compute[74482]:     </rng>
Oct 23 23:18:42 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:18:42 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:18:42 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:18:42 user nova-compute[74482]:     </memballoon>
Oct 23 23:18:42 user nova-compute[74482]:   </devices>
Oct 23 23:18:42 user nova-compute[74482]: </domain>
Oct 23 23:18:42 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b2:c0,bridge_name='br-int',has_traffic_filtering=True,id=6c38883d-5612-4b06-928e-e6119b34020b,network=Network(d892f962-1c0f-4d13-8e64-d6eca45ae04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c38883d-56') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b2:c0,bridge_name='br-int',has_traffic_filtering=True,id=6c38883d-5612-4b06-928e-e6119b34020b,network=Network(d892f962-1c0f-4d13-8e64-d6eca45ae04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c38883d-56') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd86eb895-2a4e-59f1-b956-9eb8ab833838', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c38883d-56, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c38883d-56, col_values=(('qos', UUID('f9ac948c-39bd-42e3-81fb-3069e209ee7e')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c38883d-56, col_values=(('external_ids', {'iface-id': '6c38883d-5612-4b06-928e-e6119b34020b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:b2:c0', 'vm-uuid': '9f06ae6e-bd11-437e-817c-e245be9afdae'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: INFO os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b2:c0,bridge_name='br-int',has_traffic_filtering=True,id=6c38883d-5612-4b06-928e-e6119b34020b,network=Network(d892f962-1c0f-4d13-8e64-d6eca45ae04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c38883d-56')
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:2b:0a,bridge_name='br-int',has_traffic_filtering=True,id=ede33686-8b6e-46d2-ae50-1c7ecb791d7e,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapede33686-8b') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2b:0a,bridge_name='br-int',has_traffic_filtering=True,id=ede33686-8b6e-46d2-ae50-1c7ecb791d7e,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapede33686-8b') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bba3df70-4ffc-5d68-af25-f5f8cda68dd3', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapede33686-8b, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapede33686-8b, col_values=(('qos', UUID('e2e4e62c-b3d3-499d-859b-085b0d616789')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapede33686-8b, col_values=(('external_ids', {'iface-id': 'ede33686-8b6e-46d2-ae50-1c7ecb791d7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:2b:0a', 'vm-uuid': '9f06ae6e-bd11-437e-817c-e245be9afdae'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: INFO os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2b:0a,bridge_name='br-int',has_traffic_filtering=True,id=ede33686-8b6e-46d2-ae50-1c7ecb791d7e,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapede33686-8b')
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:a2:af,bridge_name='br-int',has_traffic_filtering=True,id=fb533230-30d2-4006-adf8-60c66ab60fab,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb533230-30') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:a2:af,bridge_name='br-int',has_traffic_filtering=True,id=fb533230-30d2-4006-adf8-60c66ab60fab,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb533230-30') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfc4c963-7734-595e-8b95-81905f151942', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb533230-30, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb533230-30, col_values=(('qos', UUID('8de57713-6b01-48a1-be68-2c0be8be0242')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb533230-30, col_values=(('external_ids', {'iface-id': 'fb533230-30d2-4006-adf8-60c66ab60fab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:a2:af', 'vm-uuid': '9f06ae6e-bd11-437e-817c-e245be9afdae'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: INFO os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:a2:af,bridge_name='br-int',has_traffic_filtering=True,id=fb533230-30d2-4006-adf8-60c66ab60fab,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb533230-30')
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:10:ab,bridge_name='br-int',has_traffic_filtering=True,id=dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec80ea9-e4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:10:ab,bridge_name='br-int',has_traffic_filtering=True,id=dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec80ea9-e4') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a694e8e-5f8c-5634-ac44-39d501e4dd37', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdec80ea9-e4, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdec80ea9-e4, col_values=(('qos', UUID('c02234ef-c8fd-4277-9042-78fe24bafad7')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdec80ea9-e4, col_values=(('external_ids', {'iface-id': 'dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:10:ab', 'vm-uuid': '9f06ae6e-bd11-437e-817c-e245be9afdae'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: INFO os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:10:ab,bridge_name='br-int',has_traffic_filtering=True,id=dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec80ea9-e4')
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d6,bridge_name='br-int',has_traffic_filtering=True,id=f88eff13-8f21-42b1-ac4f-6976acf42ed7,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88eff13-8f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d6,bridge_name='br-int',has_traffic_filtering=True,id=f88eff13-8f21-42b1-ac4f-6976acf42ed7,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88eff13-8f') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d5f3a22-c620-5931-a417-fe5cd5309074', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf88eff13-8f, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf88eff13-8f, col_values=(('qos', UUID('7fe11039-504c-4eba-917e-3df4a37f1352')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf88eff13-8f, col_values=(('external_ids', {'iface-id': 'f88eff13-8f21-42b1-ac4f-6976acf42ed7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:88:d6', 'vm-uuid': '9f06ae6e-bd11-437e-817c-e245be9afdae'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: INFO os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d6,bridge_name='br-int',has_traffic_filtering=True,id=f88eff13-8f21-42b1-ac4f-6976acf42ed7,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88eff13-8f')
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:47,bridge_name='br-int',has_traffic_filtering=True,id=3607096f-a4dc-4f09-9be4-857c5f4cd6bd,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3607096f-a4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:47,bridge_name='br-int',has_traffic_filtering=True,id=3607096f-a4dc-4f09-9be4-857c5f4cd6bd,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3607096f-a4') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22ac8cc2-02a0-5f68-975d-73189564bd93', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3607096f-a4, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3607096f-a4, col_values=(('qos', UUID('1a65413a-a8da-48a8-8fc4-6d6492eef922')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3607096f-a4, col_values=(('external_ids', {'iface-id': '3607096f-a4dc-4f09-9be4-857c5f4cd6bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:e4:47', 'vm-uuid': '9f06ae6e-bd11-437e-817c-e245be9afdae'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: INFO os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:47,bridge_name='br-int',has_traffic_filtering=True,id=3607096f-a4dc-4f09-9be4-857c5f4cd6bd,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3607096f-a4')
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:27:88,bridge_name='br-int',has_traffic_filtering=True,id=5d77bd19-daa8-4658-94f3-b53ae5852c39,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77bd19-da') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:27:88,bridge_name='br-int',has_traffic_filtering=True,id=5d77bd19-daa8-4658-94f3-b53ae5852c39,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77bd19-da') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9819f973-300f-54b2-b81c-a62d4b76ec1a', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: INFO nova.compute.manager [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Detaching volume c73f8739-efba-47fc-abcf-b65a9499e4aa
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d77bd19-da, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d77bd19-da, col_values=(('qos', UUID('f69b4453-a8b4-4ab2-b963-219d5e975701')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d77bd19-da, col_values=(('external_ids', {'iface-id': '5d77bd19-daa8-4658-94f3-b53ae5852c39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:27:88', 'vm-uuid': '9f06ae6e-bd11-437e-817c-e245be9afdae'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:42 user nova-compute[74482]: INFO nova.virt.block_device [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Attempting to driver detach volume c73f8739-efba-47fc-abcf-b65a9499e4aa from mountpoint /dev/vdb
Oct 23 23:18:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Attempting to detach device vdb from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:18:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:18:43 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:18:43 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:18:43 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:18:43 user nova-compute[74482]:   <serial>c73f8739-efba-47fc-abcf-b65a9499e4aa</serial>
Oct 23 23:18:43 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:18:43 user nova-compute[74482]: </disk>
Oct 23 23:18:43 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:18:43 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully detached device vdb from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 from the persistent domain config.
Oct 23 23:18:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:18:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:18:43 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:18:43 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:18:43 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:18:43 user nova-compute[74482]:   <serial>c73f8739-efba-47fc-abcf-b65a9499e4aa</serial>
Oct 23 23:18:43 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:18:43 user nova-compute[74482]: </disk>
Oct 23 23:18:43 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:18:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:43 user nova-compute[74482]: INFO os_vif [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:27:88,bridge_name='br-int',has_traffic_filtering=True,id=5d77bd19-daa8-4658-94f3-b53ae5852c39,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77bd19-da')
Oct 23 23:18:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] No BDM found with device name hda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:18:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:18:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] No VIF found with MAC fa:16:3e:92:b2:c0, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:18:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] No VIF found with MAC fa:16:3e:b1:88:d6, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:18:43 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Using config drive
Oct 23 23:18:43 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Creating config drive at /opt/stack/data/nova/instances/9f06ae6e-bd11-437e-817c-e245be9afdae/disk.config
Oct 23 23:18:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f06ae6e-bd11-437e-817c-e245be9afdae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdmufaefu {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f06ae6e-bd11-437e-817c-e245be9afdae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdmufaefu" returned: 0 in 0.074s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:18:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-b526285c-c09b-4e77-b24c-151018f7411e req-32d64d41-2d7c-4fd0-9e59-65f3c8e11f4d service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b526285c-c09b-4e77-b24c-151018f7411e req-32d64d41-2d7c-4fd0-9e59-65f3c8e11f4d service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b526285c-c09b-4e77-b24c-151018f7411e req-32d64d41-2d7c-4fd0-9e59-65f3c8e11f4d service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b526285c-c09b-4e77-b24c-151018f7411e req-32d64d41-2d7c-4fd0-9e59-65f3c8e11f4d service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-b526285c-c09b-4e77-b24c-151018f7411e req-32d64d41-2d7c-4fd0-9e59-65f3c8e11f4d service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:45 user nova-compute[74482]: WARNING nova.compute.manager [req-b526285c-c09b-4e77-b24c-151018f7411e req-32d64d41-2d7c-4fd0-9e59-65f3c8e11f4d service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e for instance with vm_state building and task_state spawning.
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-835a94fb-8d64-45fb-b0ae-2868696481e5 req-fd978c5b-1847-426a-9576-95b3f159df35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-835a94fb-8d64-45fb-b0ae-2868696481e5 req-fd978c5b-1847-426a-9576-95b3f159df35 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-835a94fb-8d64-45fb-b0ae-2868696481e5 req-fd978c5b-1847-426a-9576-95b3f159df35 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-835a94fb-8d64-45fb-b0ae-2868696481e5 req-fd978c5b-1847-426a-9576-95b3f159df35 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-835a94fb-8d64-45fb-b0ae-2868696481e5 req-fd978c5b-1847-426a-9576-95b3f159df35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:46 user nova-compute[74482]: WARNING nova.compute.manager [req-835a94fb-8d64-45fb-b0ae-2868696481e5 req-fd978c5b-1847-426a-9576-95b3f159df35 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 for instance with vm_state building and task_state spawning.
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:47 user nova-compute[74482]: WARNING nova.compute.manager [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e for instance with vm_state building and task_state spawning.
Oct 23 23:18:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:47 user nova-compute[74482]: WARNING nova.compute.manager [req-1d383e9b-cb81-4349-a259-aebaddaa3186 req-f1cf9228-b7b7-48a8-976d-171d5a1ba9d6 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 for instance with vm_state building and task_state spawning.
Oct 23 23:18:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:48 user nova-compute[74482]: WARNING nova.compute.manager [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 for instance with vm_state building and task_state spawning.
Oct 23 23:18:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:48 user nova-compute[74482]: WARNING nova.compute.manager [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 for instance with vm_state building and task_state spawning.
Oct 23 23:18:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:48 user nova-compute[74482]: WARNING nova.compute.manager [req-044950ba-8221-4044-b4f7-da762c0287c8 req-a4c1f61b-1a9c-4224-8b17-5f155d52b858 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 for instance with vm_state building and task_state spawning.
Oct 23 23:18:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:18:49 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance spawned successfully.
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-95174af6-6664-43d8-96d0-1aa9d611107a req-833bc9e1-fc15-4215-a9ad-d77043b30092 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95174af6-6664-43d8-96d0-1aa9d611107a req-833bc9e1-fc15-4215-a9ad-d77043b30092 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95174af6-6664-43d8-96d0-1aa9d611107a req-833bc9e1-fc15-4215-a9ad-d77043b30092 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95174af6-6664-43d8-96d0-1aa9d611107a req-833bc9e1-fc15-4215-a9ad-d77043b30092 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-95174af6-6664-43d8-96d0-1aa9d611107a req-833bc9e1-fc15-4215-a9ad-d77043b30092 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:49 user nova-compute[74482]: WARNING nova.compute.manager [req-95174af6-6664-43d8-96d0-1aa9d611107a req-833bc9e1-fc15-4215-a9ad-d77043b30092 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-6c38883d-5612-4b06-928e-e6119b34020b for instance with vm_state building and task_state spawning.
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.objects.instance [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:49 user nova-compute[74482]: INFO nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Took 13.01 seconds to spawn the instance on the hypervisor.
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:49 user nova-compute[74482]: INFO nova.compute.manager [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Took 73.15 seconds to build instance.
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bf595c91-3aa4-4db1-b79a-aa166e69dd80 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 73.255s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-794e6879-99b7-43e7-a639-707adfdb4d6b req-69457493-c86a-4e16-b529-74c8280f84b0 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-794e6879-99b7-43e7-a639-707adfdb4d6b req-69457493-c86a-4e16-b529-74c8280f84b0 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-794e6879-99b7-43e7-a639-707adfdb4d6b req-69457493-c86a-4e16-b529-74c8280f84b0 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-794e6879-99b7-43e7-a639-707adfdb4d6b req-69457493-c86a-4e16-b529-74c8280f84b0 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-794e6879-99b7-43e7-a639-707adfdb4d6b req-69457493-c86a-4e16-b529-74c8280f84b0 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:49 user nova-compute[74482]: WARNING nova.compute.manager [req-794e6879-99b7-43e7-a639-707adfdb4d6b req-69457493-c86a-4e16-b529-74c8280f84b0 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 for instance with vm_state active and task_state None.
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:49 user nova-compute[74482]: INFO nova.compute.manager [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attaching volume 043ca32e-1bce-495f-a9ea-3850c7d0222a to /dev/vdb
Oct 23 23:18:49 user nova-compute[74482]: DEBUG os_brick.utils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97d63f2-eec4-4376-bb16-2bbc306de347]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfce82d8-dc1e-40fe-ac6e-e6eb1af0d4fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c8941-ec03-4cf1-84b1-a65f1a18ad68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd471138-58ae-4a2c-841b-870ba4f05f5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:18:49 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:18:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[142b5eaf-9f54-48de-bf25-d8e7ed3eb385]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG os_brick.utils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:18:49 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating existing volume attachment record: 5dcd0295-a1fe-49c7-ba48-8ce11d31642a {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "fc2566c6-8911-425b-b05d-a008e67a9d34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:50 user nova-compute[74482]: INFO nova.compute.manager [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Terminating instance
Oct 23 23:18:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:51 user nova-compute[74482]: WARNING nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-6c38883d-5612-4b06-928e-e6119b34020b for instance with vm_state active and task_state None.
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:51 user nova-compute[74482]: WARNING nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-fb533230-30d2-4006-adf8-60c66ab60fab for instance with vm_state active and task_state None.
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:51 user nova-compute[74482]: WARNING nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-fb533230-30d2-4006-adf8-60c66ab60fab for instance with vm_state active and task_state None.
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:51 user nova-compute[74482]: WARNING nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd for instance with vm_state active and task_state None.
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:51 user nova-compute[74482]: WARNING nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd for instance with vm_state active and task_state None.
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received event network-vif-unplugged-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Acquiring lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] No waiting events found dispatching network-vif-unplugged-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received event network-vif-unplugged-fc58ce30-d69f-4b68-af4b-d9a687840887 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received event network-vif-plugged-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Acquiring lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] No waiting events found dispatching network-vif-plugged-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:18:51 user nova-compute[74482]: WARNING nova.compute.manager [req-772406e8-75a1-407e-8b25-8d4b29a6cca2 req-6cf69941-9a76-4111-858d-c9da85389a7b service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received unexpected event network-vif-plugged-fc58ce30-d69f-4b68-af4b-d9a687840887 for instance with vm_state active and task_state deleting.
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:51 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Instance destroyed successfully.
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lazy-loading 'resources' on Instance uuid fc2566c6-8911-425b-b05d-a008e67a9d34 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2108851944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2108851944',id=1,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='981f084ec65e4fa0a9cbd2e5edf8302a',ramdisk_id='',reservation_id='r-4pygvrqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-157113739',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:01:08Z,user_data=None,user_id='ebd17d342e7145e0bad04188ec8be780',uuid=fc2566c6-8911-425b-b05d-a008e67a9d34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converting VIF {"id": "fc58ce30-d69f-4b68-af4b-d9a687840887", "address": "fa:16:3e:db:86:7f", "network": {"id": "90e14cb0-f699-4360-a07a-a68ed163c744", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1062189173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "981f084ec65e4fa0a9cbd2e5edf8302a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc58ce30-d6", "ovs_interfaceid": "fc58ce30-d69f-4b68-af4b-d9a687840887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:86:7f,bridge_name='br-int',has_traffic_filtering=True,id=fc58ce30-d69f-4b68-af4b-d9a687840887,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc58ce30-d6') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG os_vif [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:86:7f,bridge_name='br-int',has_traffic_filtering=True,id=fc58ce30-d69f-4b68-af4b-d9a687840887,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc58ce30-d6') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc58ce30-d6, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=daa7eede-eaaf-4949-bf61-cb1fc527abe3) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:18:51 user nova-compute[74482]: INFO os_vif [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:86:7f,bridge_name='br-int',has_traffic_filtering=True,id=fc58ce30-d69f-4b68-af4b-d9a687840887,network=Network(90e14cb0-f699-4360-a07a-a68ed163c744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc58ce30-d6')
Oct 23 23:18:51 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Deleting instance files /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34_del
Oct 23 23:18:51 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Deletion of /opt/stack/data/nova/instances/fc2566c6-8911-425b-b05d-a008e67a9d34_del complete
Oct 23 23:18:51 user nova-compute[74482]: INFO nova.compute.manager [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 23 23:18:51 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:18:51 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:18:52 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Took 0.68 seconds to deallocate network for instance.
Oct 23 23:18:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:18:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:52 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Deleted allocations for instance fc2566c6-8911-425b-b05d-a008e67a9d34
Oct 23 23:18:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9073ca6-d799-4e88-b232-e371afae70b6 tempest-ServerBootFromVolumeStableRescueTest-157113739 tempest-ServerBootFromVolumeStableRescueTest-157113739-project-member] Lock "fc2566c6-8911-425b-b05d-a008e67a9d34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.205s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:18:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-c7da57d5-65cb-4e90-afdf-4001a44ac64b req-a97e9fad-5ab7-487c-897e-7c9414eda307 service nova] [instance: fc2566c6-8911-425b-b05d-a008e67a9d34] Received event network-vif-deleted-fc58ce30-d69f-4b68-af4b-d9a687840887 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:18:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:18:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:19:02 user nova-compute[74482]: INFO nova.compute.claims [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Claim successful on node user
Oct 23 23:19:02 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:19:02 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:19:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG nova.policy [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba51e10635554ff5b334776437198975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3126d7b8df44e6bdd79ae3917d3569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:19:02 user nova-compute[74482]: INFO nova.virt.block_device [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Booting with volume 13e5ee0d-543d-4151-acf2-f193008c28f2 at /dev/vda
Oct 23 23:19:02 user nova-compute[74482]: DEBUG os_brick.utils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0978b7e-e389-409a-82bd-69f500faafa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe81e936-02a8-4368-8c0f-533469849379]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac94abe-17b3-4fea-a300-8ffcec25adfd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab641ec-aaaf-4fcc-ae4e-657bedfba3d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:19:03 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b968faac-5118-4a97-9704-c00c2ce3d5c0]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.utils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating existing volume attachment record: 431fe44f-bc23-49f1-8d31-3ba83832a8df {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:03 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 is timed out.
Oct 23 23:19:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully detached device vdb from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 from the live domain config.
Oct 23 23:19:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChjmyfJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:19:03 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Successfully created port: c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2877be84-a200-4f66-a430-3b689315f05c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:19:03 user nova-compute[74482]: No targets found.
Oct 23 23:19:03 user nova-compute[74482]: iSNS:
Oct 23 23:19:03 user nova-compute[74482]: No targets found.
Oct 23 23:19:03 user nova-compute[74482]: STATIC:
Oct 23 23:19:03 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338
Oct 23 23:19:03 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:03 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:03 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa
Oct 23 23:19:03 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:03 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:03 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85
Oct 23 23:19:03 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:03 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:03 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:19:03 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:03 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:03 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334
Oct 23 23:19:03 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:03 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:03 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f
Oct 23 23:19:03 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:03 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:03 user nova-compute[74482]: FIRMWARE:
Oct 23 23:19:03 user nova-compute[74482]: No targets found.
Oct 23 23:19:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:19:03 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:19:03 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[942b8273-85e9-4696-9e20-d0c766f1f069]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7d22df-14a6-4f13-9a8d-739fad61f684]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:03 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c4372e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa'): ({'sdc'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Removing single pathed devices sdc {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f241c2c-bf8b-432e-9b1e-3fe8b7ea298f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7682d953-bacf-473e-a81a-c6655f37372a]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flushing IO for device /dev/sdc {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0405114-0014-484b-a065-1ba160717e6f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f53b9f-48c1-4350-9009-845955df73ce]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24328a8-ee7e-4b30-b57d-a7c53d4226a6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8f1faf-311e-44c4-bf77-ec2f30ae725b]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa, portal: 172.16.0.220,3260]
Oct 23 23:19:03 user nova-compute[74482]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa, portal: 172.16.0.220,3260] successful.
Oct 23 23:19:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73f8739-efba-47fc-abcf-b65a9499e4aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc053051-a236-4afd-a17a-67cdf2f0879e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== disconnect_volume: return (361ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:19:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Successfully updated port: c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquired lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-a874b2af-04b1-489d-83a1-ac4ba6022eab req-81acb4e8-ee37-4e3c-8f68-e8a598a652d2 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.compute.manager [req-a874b2af-04b1-489d-83a1-ac4ba6022eab req-81acb4e8-ee37-4e3c-8f68-e8a598a652d2 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing instance network info cache due to event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a874b2af-04b1-489d-83a1-ac4ba6022eab req-81acb4e8-ee37-4e3c-8f68-e8a598a652d2 service nova] Acquiring lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating instance_info_cache with network_info: [{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Releasing lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Instance network_info: |[{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a874b2af-04b1-489d-83a1-ac4ba6022eab req-81acb4e8-ee37-4e3c-8f68-e8a598a652d2 service nova] Acquired lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-a874b2af-04b1-489d-83a1-ac4ba6022eab req-81acb4e8-ee37-4e3c-8f68-e8a598a652d2 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.objects.instance [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-538e8b7f-68da-42d7-8e0d-55788e502151 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.927s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-a874b2af-04b1-489d-83a1-ac4ba6022eab req-81acb4e8-ee37-4e3c-8f68-e8a598a652d2 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updated VIF entry in instance network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG nova.network.neutron [req-a874b2af-04b1-489d-83a1-ac4ba6022eab req-81acb4e8-ee37-4e3c-8f68-e8a598a652d2 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating instance_info_cache with network_info: [{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:19:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a874b2af-04b1-489d-83a1-ac4ba6022eab req-81acb4e8-ee37-4e3c-8f68-e8a598a652d2 service nova] Releasing lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:19:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:05 user nova-compute[74482]: INFO nova.compute.manager [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Detaching volume cb1266e9-fa29-43cc-b377-b090fdecf334
Oct 23 23:19:05 user nova-compute[74482]: INFO nova.virt.block_device [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Attempting to driver detach volume cb1266e9-fa29-43cc-b377-b090fdecf334 from mountpoint /dev/vdc
Oct 23 23:19:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Attempting to detach device vdc from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:19:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:19:05 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:19:05 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:19:05 user nova-compute[74482]:   <target dev="vdc" bus="virtio"/>
Oct 23 23:19:05 user nova-compute[74482]:   <serial>cb1266e9-fa29-43cc-b377-b090fdecf334</serial>
Oct 23 23:19:05 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 23:19:05 user nova-compute[74482]: </disk>
Oct 23 23:19:05 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:19:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully detached device vdc from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 from the persistent domain config.
Oct 23 23:19:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:19:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:19:05 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:19:05 user nova-compute[74482]:   <source dev="/dev/sdf"/>
Oct 23 23:19:05 user nova-compute[74482]:   <target dev="vdc" bus="virtio"/>
Oct 23 23:19:05 user nova-compute[74482]:   <serial>cb1266e9-fa29-43cc-b377-b090fdecf334</serial>
Oct 23 23:19:05 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 23:19:05 user nova-compute[74482]: </disk>
Oct 23 23:19:05 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:19:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:19:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epZzELNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:19:10 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:19:10 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:19:10 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[232d323d-8670-4066-af8d-a71838ba84b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:19:10 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[600a953d-8660-4161-b822-c77652ee58f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a] added
Oct 23 23:19:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cff527-8e1b-4f75-96be-438662f6a629]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced135e8-d1bb-447e-a323-9fa368ff78d8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epZzELNX {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epZzELNX" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eef8dfb-c95d-4000-a084-0965f57bd779]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epZzELNX'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a807b4-8932-4253-a51c-82528a2fc80a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09ddac1-6ba2-4612-95c2-4151f354c2d9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6edb9c-37ee-4ef9-8083-13c2fae39e4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a, portal: 172.16.0.220,3260]
Oct 23 23:19:10 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a, portal: 172.16.0.220,3260] successful.
Oct 23 23:19:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2793d8-cefa-4bfb-ad7d-60ba151273df]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b80267-da4f-4347-adb7-ca66f0544af0]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:10 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:10 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[881f1645-5166-4349-b68a-46495635d167]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:10 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epZzELNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23834623233613864', 'path': '/dev/sdc'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834623233613864', 'path': '/dev/sdc'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG nova.objects.instance [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:19:11 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:19:11 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:19:11 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:19:11 user nova-compute[74482]:   <serial>043ca32e-1bce-495f-a9ea-3850c7d0222a</serial>
Oct 23 23:19:11 user nova-compute[74482]: </disk>
Oct 23 23:19:11 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:19:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No VIF found with MAC fa:16:3e:f8:5e:d4, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:19:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-86647c30-23a6-4375-ba98-bf8925f1f990 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.285s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:14 user nova-compute[74482]: INFO nova.compute.manager [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Detaching volume 043ca32e-1bce-495f-a9ea-3850c7d0222a
Oct 23 23:19:14 user nova-compute[74482]: INFO nova.virt.block_device [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attempting to driver detach volume 043ca32e-1bce-495f-a9ea-3850c7d0222a from mountpoint /dev/vdb
Oct 23 23:19:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Attempting to detach device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:19:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:19:14 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:19:14 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:19:14 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:19:14 user nova-compute[74482]:   <serial>043ca32e-1bce-495f-a9ea-3850c7d0222a</serial>
Oct 23 23:19:14 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:19:14 user nova-compute[74482]: </disk>
Oct 23 23:19:14 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:19:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully detached device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the persistent domain config.
Oct 23 23:19:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:19:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:19:14 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:19:14 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:19:14 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:19:14 user nova-compute[74482]:   <serial>043ca32e-1bce-495f-a9ea-3850c7d0222a</serial>
Oct 23 23:19:14 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:19:14 user nova-compute[74482]: </disk>
Oct 23 23:19:14 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:19:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:19:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:19:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:19:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:19:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:19:22 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Creating image(s)
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Ensure instance console log exists: /opt/stack/data/nova/instances/aa45561e-5737-4389-af16-9fe6843d09ec/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Start _get_guest_xml network_info=[{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vISYythD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa45561e-5737-4389-af16-9fe6843d09ec', 'attached_at': '', 'detached_at': '', 'volume_id': '13e5ee0d-543d-4151-acf2-f193008c28f2', 'serial': '13e5ee0d-543d-4151-acf2-f193008c28f2'}, 'disk_bus': 'virtio', 'attachment_id': '431fe44f-bc23-49f1-8d31-3ba83832a8df', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:19:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:19:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vISYythD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:19:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:19:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:19:22 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f181b-4ff2-405f-aa40-d7c33b10fc45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:19:22 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d824c57-c0a0-45ae-b00b-df12265537b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2] added
Oct 23 23:19:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[099a83c0-cf6d-4f34-8ed7-d4c1286c5342]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f1cfab-e0f6-4918-806b-47aff34abaa5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vISYythD {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vISYythD" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab34c019-2e48-4b3e-b31e-0410350bcc80]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vISYythD'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9dcbab-62e7-4a95-82f2-0d4dafd9de39]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ff43a-531c-4024-b3c2-5779a2770777]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[486992c2-1707-42a5-9826-de75b968f56c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260]
Oct 23 23:19:22 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260] successful.
Oct 23 23:19:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8720b94-b2d9-421b-a2dd-d284ef3a9962]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28f999-1598-443c-a681-75b338f1d1a9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:22 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:19:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] HCTL ('39', '-', '-', 0) found on session 40 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f901e0ff-91cd-4bba-af5f-1f938d080b29]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:19:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vISYythD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:19:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:19:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23233663939303039', 'path': '/dev/sdh'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:19:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233663939303039', 'path': '/dev/sdh'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1278988678',display_name='tempest-TestShelveInstance-server-1278988678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1278988678',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwsZO8eK2BSSEw92mT0Den4SJx5ndi9FgeD0dfZK/T46kiR/Ld8i85yG7Phxi/Q0LzkGd/zEcyTlfFv9bYx7QKS1kKhWHrwvbzeMS6YcRUtK1Hc/cnHJtD/eszrMCvQrA==',key_name='tempest-TestShelveInstance-346128566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3126d7b8df44e6bdd79ae3917d3569',ramdisk_id='',reservation_id='r-wpc3ins9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-267030383',owner_user_name='tempest-TestShelveInstance-267030383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:19:03Z,user_data=None,user_id='ba51e10635554ff5b334776437198975',uuid=aa45561e-5737-4389-af16-9fe6843d09ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converting VIF {"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.objects.instance [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lazy-loading 'pci_devices' on Instance uuid aa45561e-5737-4389-af16-9fe6843d09ec {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:19:24 user nova-compute[74482]:   <uuid>aa45561e-5737-4389-af16-9fe6843d09ec</uuid>
Oct 23 23:19:24 user nova-compute[74482]:   <name>instance-0000001f</name>
Oct 23 23:19:24 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:19:24 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:19:24 user nova-compute[74482]:   <metadata>
Oct 23 23:19:24 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:19:24 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:19:24 user nova-compute[74482]:       <nova:name>tempest-TestShelveInstance-server-1278988678</nova:name>
Oct 23 23:19:24 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:19:22</nova:creationTime>
Oct 23 23:19:24 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:19:24 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:19:24 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:19:24 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:19:24 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:19:24 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:19:24 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:19:24 user nova-compute[74482]:       <nova:owner>
Oct 23 23:19:24 user nova-compute[74482]:         <nova:user uuid="ba51e10635554ff5b334776437198975">tempest-TestShelveInstance-267030383-project-member</nova:user>
Oct 23 23:19:24 user nova-compute[74482]:         <nova:project uuid="0c3126d7b8df44e6bdd79ae3917d3569">tempest-TestShelveInstance-267030383</nova:project>
Oct 23 23:19:24 user nova-compute[74482]:       </nova:owner>
Oct 23 23:19:24 user nova-compute[74482]:       <nova:ports>
Oct 23 23:19:24 user nova-compute[74482]:         <nova:port uuid="c43a1b97-dc62-4f98-8e7d-14dbff60bb08">
Oct 23 23:19:24 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 23:19:24 user nova-compute[74482]:         </nova:port>
Oct 23 23:19:24 user nova-compute[74482]:       </nova:ports>
Oct 23 23:19:24 user nova-compute[74482]:     </nova:instance>
Oct 23 23:19:24 user nova-compute[74482]:   </metadata>
Oct 23 23:19:24 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:19:24 user nova-compute[74482]:     <system>
Oct 23 23:19:24 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:19:24 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:19:24 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:19:24 user nova-compute[74482]:       <entry name="serial">aa45561e-5737-4389-af16-9fe6843d09ec</entry>
Oct 23 23:19:24 user nova-compute[74482]:       <entry name="uuid">aa45561e-5737-4389-af16-9fe6843d09ec</entry>
Oct 23 23:19:24 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:19:24 user nova-compute[74482]:     </system>
Oct 23 23:19:24 user nova-compute[74482]:   </sysinfo>
Oct 23 23:19:24 user nova-compute[74482]:   <os>
Oct 23 23:19:24 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:19:24 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:19:24 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:19:24 user nova-compute[74482]:   </os>
Oct 23 23:19:24 user nova-compute[74482]:   <features>
Oct 23 23:19:24 user nova-compute[74482]:     <acpi/>
Oct 23 23:19:24 user nova-compute[74482]:     <apic/>
Oct 23 23:19:24 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:19:24 user nova-compute[74482]:   </features>
Oct 23 23:19:24 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:19:24 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:19:24 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:19:24 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:19:24 user nova-compute[74482]:   </clock>
Oct 23 23:19:24 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:19:24 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:19:24 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:19:24 user nova-compute[74482]:   </cpu>
Oct 23 23:19:24 user nova-compute[74482]:   <devices>
Oct 23 23:19:24 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:19:24 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:19:24 user nova-compute[74482]:       <source dev="/dev/sdh"/>
Oct 23 23:19:24 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:19:24 user nova-compute[74482]:       <serial>13e5ee0d-543d-4151-acf2-f193008c28f2</serial>
Oct 23 23:19:24 user nova-compute[74482]:     </disk>
Oct 23 23:19:24 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:19:24 user nova-compute[74482]:       <mac address="fa:16:3e:28:41:da"/>
Oct 23 23:19:24 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:19:24 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:19:24 user nova-compute[74482]:       <target dev="tapc43a1b97-dc"/>
Oct 23 23:19:24 user nova-compute[74482]:     </interface>
Oct 23 23:19:24 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:19:24 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/aa45561e-5737-4389-af16-9fe6843d09ec/console.log" append="off"/>
Oct 23 23:19:24 user nova-compute[74482]:     </serial>
Oct 23 23:19:24 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:19:24 user nova-compute[74482]:     <video>
Oct 23 23:19:24 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:19:24 user nova-compute[74482]:     </video>
Oct 23 23:19:24 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:19:24 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:19:24 user nova-compute[74482]:     </rng>
Oct 23 23:19:24 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:19:24 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:19:24 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:19:24 user nova-compute[74482]:     </memballoon>
Oct 23 23:19:24 user nova-compute[74482]:   </devices>
Oct 23 23:19:24 user nova-compute[74482]: </domain>
Oct 23 23:19:24 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1278988678',display_name='tempest-TestShelveInstance-server-1278988678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1278988678',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwsZO8eK2BSSEw92mT0Den4SJx5ndi9FgeD0dfZK/T46kiR/Ld8i85yG7Phxi/Q0LzkGd/zEcyTlfFv9bYx7QKS1kKhWHrwvbzeMS6YcRUtK1Hc/cnHJtD/eszrMCvQrA==',key_name='tempest-TestShelveInstance-346128566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c3126d7b8df44e6bdd79ae3917d3569',ramdisk_id='',reservation_id='r-wpc3ins9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-267030383',owner_user_name='tempest-TestShelveInstance-267030383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:19:03Z,user_data=None,user_id='ba51e10635554ff5b334776437198975',uuid=aa45561e-5737-4389-af16-9fe6843d09ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converting VIF {"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG os_vif [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46bf91a0-c4b8-5956-b342-687b7391598e', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc43a1b97-dc, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc43a1b97-dc, col_values=(('qos', UUID('ffdcf756-61ba-4ad8-9478-b796c81d9a46')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc43a1b97-dc, col_values=(('external_ids', {'iface-id': 'c43a1b97-dc62-4f98-8e7d-14dbff60bb08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:41:da', 'vm-uuid': 'aa45561e-5737-4389-af16-9fe6843d09ec'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:24 user nova-compute[74482]: INFO os_vif [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc')
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:19:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] No VIF found with MAC fa:16:3e:28:41:da, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-c813215e-5abf-4df3-a759-056c264a5b1d req-3fb7a166-017f-4828-82ae-65bb2f54477c service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c813215e-5abf-4df3-a759-056c264a5b1d req-3fb7a166-017f-4828-82ae-65bb2f54477c service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c813215e-5abf-4df3-a759-056c264a5b1d req-3fb7a166-017f-4828-82ae-65bb2f54477c service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c813215e-5abf-4df3-a759-056c264a5b1d req-3fb7a166-017f-4828-82ae-65bb2f54477c service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-c813215e-5abf-4df3-a759-056c264a5b1d req-3fb7a166-017f-4828-82ae-65bb2f54477c service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:19:25 user nova-compute[74482]: WARNING nova.compute.manager [req-c813215e-5abf-4df3-a759-056c264a5b1d req-3fb7a166-017f-4828-82ae-65bb2f54477c service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state building and task_state spawning.
Oct 23 23:19:25 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 is timed out.
Oct 23 23:19:25 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully detached device vdc from instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 from the live domain config.
Oct 23 23:19:25 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nlOISpzo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:19:25 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b63b89-d257-415d-a92f-b778b49430d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:19:25 user nova-compute[74482]: No targets found.
Oct 23 23:19:25 user nova-compute[74482]: iSNS:
Oct 23 23:19:25 user nova-compute[74482]: No targets found.
Oct 23 23:19:25 user nova-compute[74482]: STATIC:
Oct 23 23:19:25 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:19:25 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:25 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:25 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338
Oct 23 23:19:25 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:25 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:25 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85
Oct 23 23:19:25 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:25 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:25 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a
Oct 23 23:19:25 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:25 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:25 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:19:25 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:25 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:25 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334
Oct 23 23:19:25 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:25 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:25 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f
Oct 23 23:19:25 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:25 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:25 user nova-compute[74482]: FIRMWARE:
Oct 23 23:19:25 user nova-compute[74482]: No targets found.
Oct 23 23:19:25 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:19:25 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:19:25 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f9851-e79c-4dca-8981-b9bd17981cfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e401ddbe-d748-4d6e-b54e-395c55838b33]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:25 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:19:25 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c441a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334'): ({'sdf'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Removing single pathed devices sdf {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd733453-a7f0-4c91-8dc7-fa15f3dee1bd]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef67b3ce-acbf-41aa-822c-a3599f5eb26d]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Flushing IO for device /dev/sdf {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a40d05b-be9e-4525-b450-8c49061cf1ed]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1e4d27-1247-4f46-b721-68a63a769598]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] SCSI volumes sdf have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6973a77-e51b-4354-9da3-55bbb56ea943]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed855121-0e27-47c8-8cda-e7958d11e5d7]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334, portal: 172.16.0.220,3260]
Oct 23 23:19:26 user nova-compute[74482]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334, portal: 172.16.0.220,3260] successful.
Oct 23 23:19:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb1266e9-fa29-43cc-b377-b090fdecf334 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a23c63e-6982-407f-bb12-460a45827724]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] <== disconnect_volume: return (380ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG nova.objects.instance [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'flavor' on Instance uuid d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:19:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3914040c-55b1-432b-b45c-739e9b7c056a tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.774s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:19:27 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Instance spawned successfully.
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:27 user nova-compute[74482]: INFO nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Took 5.04 seconds to spawn the instance on the hypervisor.
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-5d8d160d-835c-4555-b8d9-d4193a3564ca req-9d763418-e1e8-4aa0-8a95-342b59a7b699 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5d8d160d-835c-4555-b8d9-d4193a3564ca req-9d763418-e1e8-4aa0-8a95-342b59a7b699 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5d8d160d-835c-4555-b8d9-d4193a3564ca req-9d763418-e1e8-4aa0-8a95-342b59a7b699 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5d8d160d-835c-4555-b8d9-d4193a3564ca req-9d763418-e1e8-4aa0-8a95-342b59a7b699 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-5d8d160d-835c-4555-b8d9-d4193a3564ca req-9d763418-e1e8-4aa0-8a95-342b59a7b699 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:19:27 user nova-compute[74482]: WARNING nova.compute.manager [req-5d8d160d-835c-4555-b8d9-d4193a3564ca req-9d763418-e1e8-4aa0-8a95-342b59a7b699 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state building and task_state spawning.
Oct 23 23:19:27 user nova-compute[74482]: INFO nova.compute.manager [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Took 25.39 seconds to build instance.
Oct 23 23:19:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8074ce78-4cc0-4d95-b5c0-4e0ecbad169d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.486s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:28 user nova-compute[74482]: INFO nova.compute.manager [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Terminating instance
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-1fc808c5-5a38-4baf-beff-9774212aecfb req-c0f8d4e7-45f0-4e3a-8b07-b2819a709bd5 service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received event network-vif-unplugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1fc808c5-5a38-4baf-beff-9774212aecfb req-c0f8d4e7-45f0-4e3a-8b07-b2819a709bd5 service nova] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1fc808c5-5a38-4baf-beff-9774212aecfb req-c0f8d4e7-45f0-4e3a-8b07-b2819a709bd5 service nova] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1fc808c5-5a38-4baf-beff-9774212aecfb req-c0f8d4e7-45f0-4e3a-8b07-b2819a709bd5 service nova] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-1fc808c5-5a38-4baf-beff-9774212aecfb req-c0f8d4e7-45f0-4e3a-8b07-b2819a709bd5 service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] No waiting events found dispatching network-vif-unplugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-1fc808c5-5a38-4baf-beff-9774212aecfb req-c0f8d4e7-45f0-4e3a-8b07-b2819a709bd5 service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received event network-vif-unplugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:19:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Instance destroyed successfully.
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.objects.instance [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lazy-loading 'resources' on Instance uuid d2ea53e4-399b-4b7a-9338-c1c81b3a6253 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-213171726',display_name='tempest-AttachVolumeTestJSON-server-213171726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-213171726',id=28,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQiBkkPCnvve16LbgMhmUeQ7YP2NPZIWJYitMCOMUuCTlsH9lj5NQWmm7u2keAgnpGzKeCbxM7Rz8bU6gv8GfJBhWF3Px2aXTQZxQyyiMI5j3a1N6rUlmCDf06AiUbSyg==',key_name='tempest-keypair-1365969527',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bef228274d9477091fcd021ca8271e3',ramdisk_id='',reservation_id='r-aw82trdx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1506893999',owner_user_name='tempest-AttachVolumeTestJSON-1506893999-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba4aeef9339f48d6929e4cfa97af0860',uuid=d2ea53e4-399b-4b7a-9338-c1c81b3a6253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converting VIF {"id": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "address": "fa:16:3e:70:b0:fe", "network": {"id": "67080deb-d5f6-47f2-bf37-ab0792e3e677", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1018294334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bef228274d9477091fcd021ca8271e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f23deed-5e", "ovs_interfaceid": "1f23deed-5e0c-4e81-858d-9fa8ee97b9f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:b0:fe,bridge_name='br-int',has_traffic_filtering=True,id=1f23deed-5e0c-4e81-858d-9fa8ee97b9f1,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f23deed-5e') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG os_vif [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:b0:fe,bridge_name='br-int',has_traffic_filtering=True,id=1f23deed-5e0c-4e81-858d-9fa8ee97b9f1,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f23deed-5e') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f23deed-5e, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12a1d5e1-491a-4aae-9a94-e67c9a518c15) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:19:28 user nova-compute[74482]: INFO os_vif [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:b0:fe,bridge_name='br-int',has_traffic_filtering=True,id=1f23deed-5e0c-4e81-858d-9fa8ee97b9f1,network=Network(67080deb-d5f6-47f2-bf37-ab0792e3e677),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f23deed-5e')
Oct 23 23:19:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Deleting instance files /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253_del
Oct 23 23:19:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Deletion of /opt/stack/data/nova/instances/d2ea53e4-399b-4b7a-9338-c1c81b3a6253_del complete
Oct 23 23:19:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:28 user nova-compute[74482]: INFO nova.compute.manager [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 23 23:19:28 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:19:28 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:19:29 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid 'd2ea53e4-399b-4b7a-9338-c1c81b3a6253' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd2ea53e4-399b-4b7a-9338-c1c81b3a6253' (instance-0000001c)
Oct 23 23:19:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-2f57f05f-1064-499f-a5a0-7a524b426950 req-b9f52db8-1b5d-49a9-b15d-abd057a235bc service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received event network-vif-deleted-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:29 user nova-compute[74482]: INFO nova.compute.manager [req-2f57f05f-1064-499f-a5a0-7a524b426950 req-b9f52db8-1b5d-49a9-b15d-abd057a235bc service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Neutron deleted interface 1f23deed-5e0c-4e81-858d-9fa8ee97b9f1; detaching it from the instance and deleting it from the info cache
Oct 23 23:19:29 user nova-compute[74482]: DEBUG nova.network.neutron [req-2f57f05f-1064-499f-a5a0-7a524b426950 req-b9f52db8-1b5d-49a9-b15d-abd057a235bc service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:19:29 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Took 0.94 seconds to deallocate network for instance.
Oct 23 23:19:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-2f57f05f-1064-499f-a5a0-7a524b426950 req-b9f52db8-1b5d-49a9-b15d-abd057a235bc service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Detach interface failed, port_id=1f23deed-5e0c-4e81-858d-9fa8ee97b9f1, reason: Instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.697s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-8e8d636c-22f5-41d8-ade5-f5f7fa767d3e req-65cb79ba-6de5-4f4f-9546-883cadad39dc service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received event network-vif-plugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8e8d636c-22f5-41d8-ade5-f5f7fa767d3e req-65cb79ba-6de5-4f4f-9546-883cadad39dc service nova] Acquiring lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8e8d636c-22f5-41d8-ade5-f5f7fa767d3e req-65cb79ba-6de5-4f4f-9546-883cadad39dc service nova] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8e8d636c-22f5-41d8-ade5-f5f7fa767d3e req-65cb79ba-6de5-4f4f-9546-883cadad39dc service nova] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-8e8d636c-22f5-41d8-ade5-f5f7fa767d3e req-65cb79ba-6de5-4f4f-9546-883cadad39dc service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] No waiting events found dispatching network-vif-plugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:19:30 user nova-compute[74482]: WARNING nova.compute.manager [req-8e8d636c-22f5-41d8-ade5-f5f7fa767d3e req-65cb79ba-6de5-4f4f-9546-883cadad39dc service nova] [instance: d2ea53e4-399b-4b7a-9338-c1c81b3a6253] Received unexpected event network-vif-plugged-1f23deed-5e0c-4e81-858d-9fa8ee97b9f1 for instance with vm_state deleted and task_state None.
Oct 23 23:19:30 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:19:30 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8223MB free_disk=25.10460662841797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:30 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Deleted allocations for instance d2ea53e4-399b-4b7a-9338-c1c81b3a6253
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c7e4371a-32f9-4156-bea9-b7c4b5df3100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 127d7315-74d4-4905-b203-67556d26e3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fa1823b3-f352-4a42-b287-06b9c8efbd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 9f06ae6e-bd11-437e-817c-e245be9afdae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa45561e-5737-4389-af16-9fe6843d09ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0b87f6b2-4f2b-42df-81b6-430b67b12e11 tempest-AttachVolumeTestJSON-1506893999 tempest-AttachVolumeTestJSON-1506893999-project-member] Lock "d2ea53e4-399b-4b7a-9338-c1c81b3a6253" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.819s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:30 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:19:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:19:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:19:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:32 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:19:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:34 user nova-compute[74482]: INFO nova.compute.manager [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Terminating instance
Oct 23 23:19:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-1eb083d9-e326-4256-b6a3-024befb37763 req-c17b3d48-85b7-4fc1-9368-13c232e2b97d service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received event network-vif-unplugged-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1eb083d9-e326-4256-b6a3-024befb37763 req-c17b3d48-85b7-4fc1-9368-13c232e2b97d service nova] Acquiring lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1eb083d9-e326-4256-b6a3-024befb37763 req-c17b3d48-85b7-4fc1-9368-13c232e2b97d service nova] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1eb083d9-e326-4256-b6a3-024befb37763 req-c17b3d48-85b7-4fc1-9368-13c232e2b97d service nova] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-1eb083d9-e326-4256-b6a3-024befb37763 req-c17b3d48-85b7-4fc1-9368-13c232e2b97d service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] No waiting events found dispatching network-vif-unplugged-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-1eb083d9-e326-4256-b6a3-024befb37763 req-c17b3d48-85b7-4fc1-9368-13c232e2b97d service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received event network-vif-unplugged-c4bb13fd-216f-4510-91df-11b772b3b71e for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:19:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Instance destroyed successfully.
Oct 23 23:19:34 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lazy-loading 'resources' on Instance uuid c7e4371a-32f9-4156-bea9-b7c4b5df3100 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1882742069',display_name='tempest-ServerActionsTestOtherA-server-1882742069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1882742069',id=6,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIFqjOSyUZWQsU5gFsbXrBOoj4Cp26qpoZb6ZuADPp+mJaMBG92ILD46Qtgf0LpXdVLgOqmH/QEGrVpFM/l9sAP2h6k2MXu+chElwiN2sa7paHBVT+RCfDr3O/3kW7sqg==',key_name='tempest-keypair-1686845388',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7418b41ef984478daf12ce3a2c72c3c6',ramdisk_id='',reservation_id='r-wwjw0rob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1928343369',owner_user_name='tempest-ServerActionsTestOtherA-1928343369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:59:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6e62933fe47479baf3029e44d3b8759',uuid=c7e4371a-32f9-4156-bea9-b7c4b5df3100,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converting VIF {"id": "c4bb13fd-216f-4510-91df-11b772b3b71e", "address": "fa:16:3e:c9:0c:ce", "network": {"id": "ea8b98a5-a9a0-4341-ab9e-6e16a8633657", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-632985130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7418b41ef984478daf12ce3a2c72c3c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb13fd-21", "ovs_interfaceid": "c4bb13fd-216f-4510-91df-11b772b3b71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:0c:ce,bridge_name='br-int',has_traffic_filtering=True,id=c4bb13fd-216f-4510-91df-11b772b3b71e,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb13fd-21') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG os_vif [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:0c:ce,bridge_name='br-int',has_traffic_filtering=True,id=c4bb13fd-216f-4510-91df-11b772b3b71e,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb13fd-21') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4bb13fd-21, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:34 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 127d7315-74d4-4905-b203-67556d26e3c3 is timed out.
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef551754-e3f5-41f4-b2b6-8aa3b09695f8) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully detached device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the live domain config.
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epZzELNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:19:34 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:19:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:19:34 user nova-compute[74482]: INFO os_vif [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:0c:ce,bridge_name='br-int',has_traffic_filtering=True,id=c4bb13fd-216f-4510-91df-11b772b3b71e,network=Network(ea8b98a5-a9a0-4341-ab9e-6e16a8633657),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb13fd-21')
Oct 23 23:19:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Deleting instance files /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100_del
Oct 23 23:19:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Deletion of /opt/stack/data/nova/instances/c7e4371a-32f9-4156-bea9-b7c4b5df3100_del complete
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c6adc9-437e-4747-b1ad-c63d44bb98d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:19:34 user nova-compute[74482]: No targets found.
Oct 23 23:19:34 user nova-compute[74482]: iSNS:
Oct 23 23:19:34 user nova-compute[74482]: No targets found.
Oct 23 23:19:34 user nova-compute[74482]: STATIC:
Oct 23 23:19:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:19:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338
Oct 23 23:19:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85
Oct 23 23:19:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a
Oct 23 23:19:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:19:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f
Oct 23 23:19:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:19:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:19:34 user nova-compute[74482]: FIRMWARE:
Oct 23 23:19:34 user nova-compute[74482]: No targets found.
Oct 23 23:19:34 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:19:34 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:19:34 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8c0ed6-1944-4ec7-9629-11e9666b5809]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11401a6-7ade-48dd-ae15-5c580134200a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:19:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a (non-flash)
Oct 23 23:19:35 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:19:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c4437f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a'): ({'sdc'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Removing single pathed devices sdc {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd06283-8c09-4e9f-b885-89f5f3f75b33]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2ba80f-2497-4f1c-b13d-ad487a8653e0]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Flushing IO for device /dev/sdc {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da4b38f-9a48-4e10-b873-feb6763945be]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:35 user nova-compute[74482]: INFO nova.compute.manager [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Took 0.81 seconds to destroy the instance on the hypervisor.
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e338b40-5cbc-49b8-ab24-81ec611272ff]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a322d92-6670-4942-b9a7-04992f201af7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa37d37-4d59-49ab-aca0-c1d8a4528e66]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a, portal: 172.16.0.220,3260]
Oct 23 23:19:35 user nova-compute[74482]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a, portal: 172.16.0.220,3260] successful.
Oct 23 23:19:35 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043ca32e-1bce-495f-a9ea-3850c7d0222a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd147b3-21a9-48e5-93cf-50e9c9bb85d1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== disconnect_volume: return (331ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:19:35 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Took 0.65 seconds to deallocate network for instance.
Oct 23 23:19:35 user nova-compute[74482]: DEBUG nova.compute.manager [req-d230ac7c-1fcf-4be3-8ce2-6c8e042842fa req-c3180ee6-66d0-445f-a2da-c7ce987e6379 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received event network-vif-deleted-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG nova.objects.instance [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:19:36 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Deleted allocations for instance c7e4371a-32f9-4156-bea9-b7c4b5df3100
Oct 23 23:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-77e04ae3-063c-4674-b693-89e7b0fe23a8 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.819s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4b50587f-66b1-4d60-b2c0-6815e0f84a53 tempest-ServerActionsTestOtherA-1928343369 tempest-ServerActionsTestOtherA-1928343369-project-member] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.933s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-d78862ae-8a63-428b-a086-7fc03e0012b2 req-0a85454c-69cd-4f75-8277-f266bb646f61 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received event network-vif-plugged-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d78862ae-8a63-428b-a086-7fc03e0012b2 req-0a85454c-69cd-4f75-8277-f266bb646f61 service nova] Acquiring lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d78862ae-8a63-428b-a086-7fc03e0012b2 req-0a85454c-69cd-4f75-8277-f266bb646f61 service nova] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d78862ae-8a63-428b-a086-7fc03e0012b2 req-0a85454c-69cd-4f75-8277-f266bb646f61 service nova] Lock "c7e4371a-32f9-4156-bea9-b7c4b5df3100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-d78862ae-8a63-428b-a086-7fc03e0012b2 req-0a85454c-69cd-4f75-8277-f266bb646f61 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] No waiting events found dispatching network-vif-plugged-c4bb13fd-216f-4510-91df-11b772b3b71e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:19:36 user nova-compute[74482]: WARNING nova.compute.manager [req-d78862ae-8a63-428b-a086-7fc03e0012b2 req-0a85454c-69cd-4f75-8277-f266bb646f61 service nova] [instance: c7e4371a-32f9-4156-bea9-b7c4b5df3100] Received unexpected event network-vif-plugged-c4bb13fd-216f-4510-91df-11b772b3b71e for instance with vm_state deleted and task_state None.
Oct 23 23:19:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "0d0a776b-2956-426b-965a-c57559ae00df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0d0a776b-2956-426b-965a-c57559ae00df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:19:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:51 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:19:51 user nova-compute[74482]: INFO nova.compute.claims [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Claim successful on node user
Oct 23 23:19:52 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG nova.network.neutron [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:19:52 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:19:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG nova.policy [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8af1815fe2604193909609dedcd1925a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c7b717135415dafd38e0e2eb33e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:19:52 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Creating image(s)
Oct 23 23:19:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "/opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "/opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk 1073741824" returned: 0 in 0.051s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Successfully created port: 432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Cannot resize image /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Ensure instance console log exists: /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Successfully updated port: 432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquired lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-7d7987fe-c00c-4fc6-8900-2889dbc0cd7b req-78f505a1-e8db-4305-8302-369fbde60392 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received event network-changed-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-7d7987fe-c00c-4fc6-8900-2889dbc0cd7b req-78f505a1-e8db-4305-8302-369fbde60392 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Refreshing instance network info cache due to event network-changed-432505aa-b2d9-4cfe-b6c0-d2b93cb92675. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7d7987fe-c00c-4fc6-8900-2889dbc0cd7b req-78f505a1-e8db-4305-8302-369fbde60392 service nova] Acquiring lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:19:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.network.neutron [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updating instance_info_cache with network_info: [{"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Releasing lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Instance network_info: |[{"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7d7987fe-c00c-4fc6-8900-2889dbc0cd7b req-78f505a1-e8db-4305-8302-369fbde60392 service nova] Acquired lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.network.neutron [req-7d7987fe-c00c-4fc6-8900-2889dbc0cd7b req-78f505a1-e8db-4305-8302-369fbde60392 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Refreshing network info cache for port 432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Start _get_guest_xml network_info=[{"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:19:54 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:19:54 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1191446515',display_name='tempest-ServersNegativeTestJSON-server-1191446515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1191446515',id=32,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34c7b717135415dafd38e0e2eb33e60',ramdisk_id='',reservation_id='r-iwv40pex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-683427977',owner_user_name='tempest-ServersNegativeTestJSON-683427977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:19:53Z,user_data=None,user_id='8af1815fe2604193909609dedcd1925a',uuid=0d0a776b-2956-426b-965a-c57559ae00df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converting VIF {"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:04:a4,bridge_name='br-int',has_traffic_filtering=True,id=432505aa-b2d9-4cfe-b6c0-d2b93cb92675,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap432505aa-b2') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.objects.instance [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d0a776b-2956-426b-965a-c57559ae00df {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:19:54 user nova-compute[74482]:   <uuid>0d0a776b-2956-426b-965a-c57559ae00df</uuid>
Oct 23 23:19:54 user nova-compute[74482]:   <name>instance-00000020</name>
Oct 23 23:19:54 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:19:54 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:19:54 user nova-compute[74482]:   <metadata>
Oct 23 23:19:54 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:19:54 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:19:54 user nova-compute[74482]:       <nova:name>tempest-ServersNegativeTestJSON-server-1191446515</nova:name>
Oct 23 23:19:54 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:19:54</nova:creationTime>
Oct 23 23:19:54 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:19:54 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:19:54 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:19:54 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:19:54 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:19:54 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:19:54 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:19:54 user nova-compute[74482]:       <nova:owner>
Oct 23 23:19:54 user nova-compute[74482]:         <nova:user uuid="8af1815fe2604193909609dedcd1925a">tempest-ServersNegativeTestJSON-683427977-project-member</nova:user>
Oct 23 23:19:54 user nova-compute[74482]:         <nova:project uuid="b34c7b717135415dafd38e0e2eb33e60">tempest-ServersNegativeTestJSON-683427977</nova:project>
Oct 23 23:19:54 user nova-compute[74482]:       </nova:owner>
Oct 23 23:19:54 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:19:54 user nova-compute[74482]:       <nova:ports>
Oct 23 23:19:54 user nova-compute[74482]:         <nova:port uuid="432505aa-b2d9-4cfe-b6c0-d2b93cb92675">
Oct 23 23:19:54 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 23:19:54 user nova-compute[74482]:         </nova:port>
Oct 23 23:19:54 user nova-compute[74482]:       </nova:ports>
Oct 23 23:19:54 user nova-compute[74482]:     </nova:instance>
Oct 23 23:19:54 user nova-compute[74482]:   </metadata>
Oct 23 23:19:54 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:19:54 user nova-compute[74482]:     <system>
Oct 23 23:19:54 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:19:54 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:19:54 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:19:54 user nova-compute[74482]:       <entry name="serial">0d0a776b-2956-426b-965a-c57559ae00df</entry>
Oct 23 23:19:54 user nova-compute[74482]:       <entry name="uuid">0d0a776b-2956-426b-965a-c57559ae00df</entry>
Oct 23 23:19:54 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:19:54 user nova-compute[74482]:     </system>
Oct 23 23:19:54 user nova-compute[74482]:   </sysinfo>
Oct 23 23:19:54 user nova-compute[74482]:   <os>
Oct 23 23:19:54 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:19:54 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:19:54 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:19:54 user nova-compute[74482]:   </os>
Oct 23 23:19:54 user nova-compute[74482]:   <features>
Oct 23 23:19:54 user nova-compute[74482]:     <acpi/>
Oct 23 23:19:54 user nova-compute[74482]:     <apic/>
Oct 23 23:19:54 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:19:54 user nova-compute[74482]:   </features>
Oct 23 23:19:54 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:19:54 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:19:54 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:19:54 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:19:54 user nova-compute[74482]:   </clock>
Oct 23 23:19:54 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:19:54 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:19:54 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:19:54 user nova-compute[74482]:   </cpu>
Oct 23 23:19:54 user nova-compute[74482]:   <devices>
Oct 23 23:19:54 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:19:54 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:19:54 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk"/>
Oct 23 23:19:54 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:19:54 user nova-compute[74482]:     </disk>
Oct 23 23:19:54 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:19:54 user nova-compute[74482]:       <mac address="fa:16:3e:91:04:a4"/>
Oct 23 23:19:54 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:19:54 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:19:54 user nova-compute[74482]:       <target dev="tap432505aa-b2"/>
Oct 23 23:19:54 user nova-compute[74482]:     </interface>
Oct 23 23:19:54 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:19:54 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/console.log" append="off"/>
Oct 23 23:19:54 user nova-compute[74482]:     </serial>
Oct 23 23:19:54 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:19:54 user nova-compute[74482]:     <video>
Oct 23 23:19:54 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:19:54 user nova-compute[74482]:     </video>
Oct 23 23:19:54 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:19:54 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:19:54 user nova-compute[74482]:     </rng>
Oct 23 23:19:54 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:19:54 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:19:54 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:19:54 user nova-compute[74482]:     </memballoon>
Oct 23 23:19:54 user nova-compute[74482]:   </devices>
Oct 23 23:19:54 user nova-compute[74482]: </domain>
Oct 23 23:19:54 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1191446515',display_name='tempest-ServersNegativeTestJSON-server-1191446515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1191446515',id=32,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34c7b717135415dafd38e0e2eb33e60',ramdisk_id='',reservation_id='r-iwv40pex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-683427977',owner_user_name='tempest-ServersNegativeTestJSON-683427977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:19:53Z,user_data=None,user_id='8af1815fe2604193909609dedcd1925a',uuid=0d0a776b-2956-426b-965a-c57559ae00df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converting VIF {"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:04:a4,bridge_name='br-int',has_traffic_filtering=True,id=432505aa-b2d9-4cfe-b6c0-d2b93cb92675,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap432505aa-b2') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG os_vif [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:04:a4,bridge_name='br-int',has_traffic_filtering=True,id=432505aa-b2d9-4cfe-b6c0-d2b93cb92675,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap432505aa-b2') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '568fecbf-e5ec-5cb3-b036-9e28240b243c', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap432505aa-b2, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap432505aa-b2, col_values=(('qos', UUID('677b636f-ce44-45c4-9699-ec681af3cb86')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap432505aa-b2, col_values=(('external_ids', {'iface-id': '432505aa-b2d9-4cfe-b6c0-d2b93cb92675', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:04:a4', 'vm-uuid': '0d0a776b-2956-426b-965a-c57559ae00df'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:54 user nova-compute[74482]: INFO os_vif [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:04:a4,bridge_name='br-int',has_traffic_filtering=True,id=432505aa-b2d9-4cfe-b6c0-d2b93cb92675,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap432505aa-b2')
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] No VIF found with MAC fa:16:3e:91:04:a4, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.network.neutron [req-7d7987fe-c00c-4fc6-8900-2889dbc0cd7b req-78f505a1-e8db-4305-8302-369fbde60392 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updated VIF entry in instance network info cache for port 432505aa-b2d9-4cfe-b6c0-d2b93cb92675. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG nova.network.neutron [req-7d7987fe-c00c-4fc6-8900-2889dbc0cd7b req-78f505a1-e8db-4305-8302-369fbde60392 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updating instance_info_cache with network_info: [{"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:19:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7d7987fe-c00c-4fc6-8900-2889dbc0cd7b req-78f505a1-e8db-4305-8302-369fbde60392 service nova] Releasing lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:19:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-a38d64f4-ad8c-449b-96d7-40bbcecf2a66 req-111acf19-d31e-456e-925b-1c915f9fe747 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received event network-vif-plugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a38d64f4-ad8c-449b-96d7-40bbcecf2a66 req-111acf19-d31e-456e-925b-1c915f9fe747 service nova] Acquiring lock "0d0a776b-2956-426b-965a-c57559ae00df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a38d64f4-ad8c-449b-96d7-40bbcecf2a66 req-111acf19-d31e-456e-925b-1c915f9fe747 service nova] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a38d64f4-ad8c-449b-96d7-40bbcecf2a66 req-111acf19-d31e-456e-925b-1c915f9fe747 service nova] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-a38d64f4-ad8c-449b-96d7-40bbcecf2a66 req-111acf19-d31e-456e-925b-1c915f9fe747 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] No waiting events found dispatching network-vif-plugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:19:55 user nova-compute[74482]: WARNING nova.compute.manager [req-a38d64f4-ad8c-449b-96d7-40bbcecf2a66 req-111acf19-d31e-456e-925b-1c915f9fe747 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received unexpected event network-vif-plugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 for instance with vm_state building and task_state spawning.
Oct 23 23:19:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:19:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Instance spawned successfully.
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-64b1985d-89a7-4102-8c90-ef8c33d025df req-6fadb746-3e99-41ab-8ede-8358dd90bedf service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received event network-vif-plugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-64b1985d-89a7-4102-8c90-ef8c33d025df req-6fadb746-3e99-41ab-8ede-8358dd90bedf service nova] Acquiring lock "0d0a776b-2956-426b-965a-c57559ae00df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-64b1985d-89a7-4102-8c90-ef8c33d025df req-6fadb746-3e99-41ab-8ede-8358dd90bedf service nova] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-64b1985d-89a7-4102-8c90-ef8c33d025df req-6fadb746-3e99-41ab-8ede-8358dd90bedf service nova] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-64b1985d-89a7-4102-8c90-ef8c33d025df req-6fadb746-3e99-41ab-8ede-8358dd90bedf service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] No waiting events found dispatching network-vif-plugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:19:57 user nova-compute[74482]: WARNING nova.compute.manager [req-64b1985d-89a7-4102-8c90-ef8c33d025df req-6fadb746-3e99-41ab-8ede-8358dd90bedf service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received unexpected event network-vif-plugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 for instance with vm_state building and task_state spawning.
Oct 23 23:19:57 user nova-compute[74482]: INFO nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Took 5.10 seconds to spawn the instance on the hypervisor.
Oct 23 23:19:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:19:57 user nova-compute[74482]: INFO nova.compute.manager [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Took 6.09 seconds to build instance.
Oct 23 23:19:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91397c64-d3e9-4735-98b4-dc450c95c8c5 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0d0a776b-2956-426b-965a-c57559ae00df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.187s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:19:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:19:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:09 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:20:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:09 user nova-compute[74482]: INFO nova.compute.manager [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attaching volume 4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 to /dev/vdb
Oct 23 23:20:09 user nova-compute[74482]: DEBUG os_brick.utils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7236fbda-b008-4cfc-884e-630ec472ae8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa8a1bb-9676-47b4-95a7-efb8627b3457]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc367878-16d6-4e3c-9837-35897e4a91cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ad8b6a-a9dd-4351-8c2c-f7d6ccce724d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:20:10 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:20:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d4af14-1636-468c-bb50-22d86b88a901]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG os_brick.utils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:20:10 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating existing volume attachment record: 9b3bb990-92c8-4601-b9e1-d633a92e83d2 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:20:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-d5634096-6a50-40f6-aeb1-51ad8ee3cdcf req-8789e1f0-2d86-46ba-a8d7-92c6621d2d1a service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-d5634096-6a50-40f6-aeb1-51ad8ee3cdcf req-8789e1f0-2d86-46ba-a8d7-92c6621d2d1a service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing instance network info cache due to event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:20:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d5634096-6a50-40f6-aeb1-51ad8ee3cdcf req-8789e1f0-2d86-46ba-a8d7-92c6621d2d1a service nova] Acquiring lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:20:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d5634096-6a50-40f6-aeb1-51ad8ee3cdcf req-8789e1f0-2d86-46ba-a8d7-92c6621d2d1a service nova] Acquired lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:20:12 user nova-compute[74482]: DEBUG nova.network.neutron [req-d5634096-6a50-40f6-aeb1-51ad8ee3cdcf req-8789e1f0-2d86-46ba-a8d7-92c6621d2d1a service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:20:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:12 user nova-compute[74482]: DEBUG nova.network.neutron [req-d5634096-6a50-40f6-aeb1-51ad8ee3cdcf req-8789e1f0-2d86-46ba-a8d7-92c6621d2d1a service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updated VIF entry in instance network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:20:12 user nova-compute[74482]: DEBUG nova.network.neutron [req-d5634096-6a50-40f6-aeb1-51ad8ee3cdcf req-8789e1f0-2d86-46ba-a8d7-92c6621d2d1a service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updating instance_info_cache with network_info: [{"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:20:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d5634096-6a50-40f6-aeb1-51ad8ee3cdcf req-8789e1f0-2d86-46ba-a8d7-92c6621d2d1a service nova] Releasing lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:20:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:13 user nova-compute[74482]: INFO nova.compute.manager [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Detaching volume e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:20:13 user nova-compute[74482]: INFO nova.virt.block_device [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Attempting to driver detach volume e83539a8-e374-4e24-8a5e-489c0e158011 from mountpoint /dev/vdb
Oct 23 23:20:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Attempting to detach device vdb from instance fa1823b3-f352-4a42-b287-06b9c8efbd58 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:20:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:20:13 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:20:13 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:20:13 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:20:13 user nova-compute[74482]:   <serial>e83539a8-e374-4e24-8a5e-489c0e158011</serial>
Oct 23 23:20:13 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:20:13 user nova-compute[74482]: </disk>
Oct 23 23:20:13 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:20:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully detached device vdb from instance fa1823b3-f352-4a42-b287-06b9c8efbd58 from the persistent domain config.
Oct 23 23:20:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa1823b3-f352-4a42-b287-06b9c8efbd58 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:20:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:20:13 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:20:13 user nova-compute[74482]:   <source dev="/dev/sde"/>
Oct 23 23:20:13 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:20:13 user nova-compute[74482]:   <serial>e83539a8-e374-4e24-8a5e-489c0e158011</serial>
Oct 23 23:20:13 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:20:13 user nova-compute[74482]: </disk>
Oct 23 23:20:13 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:20:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa1823b3-f352-4a42-b287-06b9c8efbd58 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG nova.compute.manager [req-a9357b62-174d-4d7a-b2fb-c048e833586d req-30532354-0cf8-40f7-a0b6-20c355ae1a51 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG nova.compute.manager [req-a9357b62-174d-4d7a-b2fb-c048e833586d req-30532354-0cf8-40f7-a0b6-20c355ae1a51 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing instance network info cache due to event network-changed-adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a9357b62-174d-4d7a-b2fb-c048e833586d req-30532354-0cf8-40f7-a0b6-20c355ae1a51 service nova] Acquiring lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a9357b62-174d-4d7a-b2fb-c048e833586d req-30532354-0cf8-40f7-a0b6-20c355ae1a51 service nova] Acquired lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG nova.network.neutron [req-a9357b62-174d-4d7a-b2fb-c048e833586d req-30532354-0cf8-40f7-a0b6-20c355ae1a51 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Refreshing network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG nova.network.neutron [req-a9357b62-174d-4d7a-b2fb-c048e833586d req-30532354-0cf8-40f7-a0b6-20c355ae1a51 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updated VIF entry in instance network info cache for port adfd802f-80e5-4834-88c9-112cdb39bd3b. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG nova.network.neutron [req-a9357b62-174d-4d7a-b2fb-c048e833586d req-30532354-0cf8-40f7-a0b6-20c355ae1a51 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updating instance_info_cache with network_info: [{"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:20:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a9357b62-174d-4d7a-b2fb-c048e833586d req-30532354-0cf8-40f7-a0b6-20c355ae1a51 service nova] Releasing lock "refresh_cache-fa1823b3-f352-4a42-b287-06b9c8efbd58" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:20:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:20:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:20:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:20:16 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:20:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating instance_info_cache with network_info: [{"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:20:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:20:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:20:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-61a80bd8-03e4-4653-b69d-b0b44252ab70 req-4adb3e9d-431e-41c2-a17f-1f9f53aafaed service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-changed-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-61a80bd8-03e4-4653-b69d-b0b44252ab70 req-4adb3e9d-431e-41c2-a17f-1f9f53aafaed service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing instance network info cache due to event network-changed-6c38883d-5612-4b06-928e-e6119b34020b. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:20:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-61a80bd8-03e4-4653-b69d-b0b44252ab70 req-4adb3e9d-431e-41c2-a17f-1f9f53aafaed service nova] Acquiring lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:20:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-61a80bd8-03e4-4653-b69d-b0b44252ab70 req-4adb3e9d-431e-41c2-a17f-1f9f53aafaed service nova] Acquired lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:20:17 user nova-compute[74482]: DEBUG nova.network.neutron [req-61a80bd8-03e4-4653-b69d-b0b44252ab70 req-4adb3e9d-431e-41c2-a17f-1f9f53aafaed service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Refreshing network info cache for port 6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:20:18 user nova-compute[74482]: DEBUG nova.network.neutron [req-61a80bd8-03e4-4653-b69d-b0b44252ab70 req-4adb3e9d-431e-41c2-a17f-1f9f53aafaed service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updated VIF entry in instance network info cache for port 6c38883d-5612-4b06-928e-e6119b34020b. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:20:18 user nova-compute[74482]: DEBUG nova.network.neutron [req-61a80bd8-03e4-4653-b69d-b0b44252ab70 req-4adb3e9d-431e-41c2-a17f-1f9f53aafaed service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [{"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:20:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-61a80bd8-03e4-4653-b69d-b0b44252ab70 req-4adb3e9d-431e-41c2-a17f-1f9f53aafaed service nova] Releasing lock "refresh_cache-9f06ae6e-bd11-437e-817c-e245be9afdae" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:20:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:20:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:20:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:20 user nova-compute[74482]: INFO nova.compute.manager [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Terminating instance
Oct 23 23:20:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-fc5ea39d-c277-437a-98a8-efc27391d21b req-a7e75fe8-d244-4cce-8e80-363f2cafb818 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fc5ea39d-c277-437a-98a8-efc27391d21b req-a7e75fe8-d244-4cce-8e80-363f2cafb818 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fc5ea39d-c277-437a-98a8-efc27391d21b req-a7e75fe8-d244-4cce-8e80-363f2cafb818 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fc5ea39d-c277-437a-98a8-efc27391d21b req-a7e75fe8-d244-4cce-8e80-363f2cafb818 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-fc5ea39d-c277-437a-98a8-efc27391d21b req-a7e75fe8-d244-4cce-8e80-363f2cafb818 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-unplugged-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-fc5ea39d-c277-437a-98a8-efc27391d21b req-a7e75fe8-d244-4cce-8e80-363f2cafb818 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-6c38883d-5612-4b06-928e-e6119b34020b for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-3284c361-3fb7-4d38-b770-580d7b94a089 req-f7f99f01-73c1-47a7-84c3-9f20869461d1 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3284c361-3fb7-4d38-b770-580d7b94a089 req-f7f99f01-73c1-47a7-84c3-9f20869461d1 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3284c361-3fb7-4d38-b770-580d7b94a089 req-f7f99f01-73c1-47a7-84c3-9f20869461d1 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3284c361-3fb7-4d38-b770-580d7b94a089 req-f7f99f01-73c1-47a7-84c3-9f20869461d1 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-3284c361-3fb7-4d38-b770-580d7b94a089 req-f7f99f01-73c1-47a7-84c3-9f20869461d1 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-unplugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-3284c361-3fb7-4d38-b770-580d7b94a089 req-f7f99f01-73c1-47a7-84c3-9f20869461d1 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-8abaaeae-2969-4918-9afc-20ba26d69592 req-26ae1495-eb70-4ab9-8814-6d15711caa45 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8abaaeae-2969-4918-9afc-20ba26d69592 req-26ae1495-eb70-4ab9-8814-6d15711caa45 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8abaaeae-2969-4918-9afc-20ba26d69592 req-26ae1495-eb70-4ab9-8814-6d15711caa45 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8abaaeae-2969-4918-9afc-20ba26d69592 req-26ae1495-eb70-4ab9-8814-6d15711caa45 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-8abaaeae-2969-4918-9afc-20ba26d69592 req-26ae1495-eb70-4ab9-8814-6d15711caa45 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-unplugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-8abaaeae-2969-4918-9afc-20ba26d69592 req-26ae1495-eb70-4ab9-8814-6d15711caa45 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Instance destroyed successfully.
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.objects.instance [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lazy-loading 'resources' on Instance uuid 9f06ae6e-bd11-437e-817c-e245be9afdae {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:b2:c0,bridge_name='br-int',has_traffic_filtering=True,id=6c38883d-5612-4b06-928e-e6119b34020b,network=Network(d892f962-1c0f-4d13-8e64-d6eca45ae04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c38883d-56') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:b2:c0,bridge_name='br-int',has_traffic_filtering=True,id=6c38883d-5612-4b06-928e-e6119b34020b,network=Network(d892f962-1c0f-4d13-8e64-d6eca45ae04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c38883d-56') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c38883d-56, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9ac948c-39bd-42e3-81fb-3069e209ee7e) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: INFO os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:b2:c0,bridge_name='br-int',has_traffic_filtering=True,id=6c38883d-5612-4b06-928e-e6119b34020b,network=Network(d892f962-1c0f-4d13-8e64-d6eca45ae04f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c38883d-56')
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:2b:0a,bridge_name='br-int',has_traffic_filtering=True,id=ede33686-8b6e-46d2-ae50-1c7ecb791d7e,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapede33686-8b') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2b:0a,bridge_name='br-int',has_traffic_filtering=True,id=ede33686-8b6e-46d2-ae50-1c7ecb791d7e,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapede33686-8b') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapede33686-8b, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2e4e62c-b3d3-499d-859b-085b0d616789) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: INFO os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:2b:0a,bridge_name='br-int',has_traffic_filtering=True,id=ede33686-8b6e-46d2-ae50-1c7ecb791d7e,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapede33686-8b')
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:a2:af,bridge_name='br-int',has_traffic_filtering=True,id=fb533230-30d2-4006-adf8-60c66ab60fab,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb533230-30') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:a2:af,bridge_name='br-int',has_traffic_filtering=True,id=fb533230-30d2-4006-adf8-60c66ab60fab,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb533230-30') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb533230-30, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8de57713-6b01-48a1-be68-2c0be8be0242) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: INFO os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:a2:af,bridge_name='br-int',has_traffic_filtering=True,id=fb533230-30d2-4006-adf8-60c66ab60fab,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfb533230-30')
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:10:ab,bridge_name='br-int',has_traffic_filtering=True,id=dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec80ea9-e4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:10:ab,bridge_name='br-int',has_traffic_filtering=True,id=dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec80ea9-e4') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdec80ea9-e4, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c02234ef-c8fd-4277-9042-78fe24bafad7) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: INFO os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:10:ab,bridge_name='br-int',has_traffic_filtering=True,id=dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec80ea9-e4')
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d6,bridge_name='br-int',has_traffic_filtering=True,id=f88eff13-8f21-42b1-ac4f-6976acf42ed7,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88eff13-8f') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d6,bridge_name='br-int',has_traffic_filtering=True,id=f88eff13-8f21-42b1-ac4f-6976acf42ed7,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88eff13-8f') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf88eff13-8f, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fe11039-504c-4eba-917e-3df4a37f1352) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: INFO os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:88:d6,bridge_name='br-int',has_traffic_filtering=True,id=f88eff13-8f21-42b1-ac4f-6976acf42ed7,network=Network(4fbf5170-dcf7-4bd6-9c52-8df070985f00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88eff13-8f')
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "address": "fa:16:3e:7d:e4:47", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3607096f-a4", "ovs_interfaceid": "3607096f-a4dc-4f09-9be4-857c5f4cd6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:47,bridge_name='br-int',has_traffic_filtering=True,id=3607096f-a4dc-4f09-9be4-857c5f4cd6bd,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3607096f-a4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:47,bridge_name='br-int',has_traffic_filtering=True,id=3607096f-a4dc-4f09-9be4-857c5f4cd6bd,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3607096f-a4') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3607096f-a4, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a65413a-a8da-48a8-8fc4-6d6492eef922) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: INFO os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e4:47,bridge_name='br-int',has_traffic_filtering=True,id=3607096f-a4dc-4f09-9be4-857c5f4cd6bd,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3607096f-a4')
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T23:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-340781614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-340781614',id=30,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKDZ91ES1thuRgYsYAoqawIskmaKuQJEsm8CjnCsNywuWtIoatURegNpC3sGHhw32CV2V8o+KSLOJDfDSC6GySZlG099J1Za3IjqABCX16kwULw0CWX1ecgo6zPcaajFQ==',key_name='tempest-keypair-1982144211',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f4563c2e2ad42fa9cb3880a8b628f66',ramdisk_id='',reservation_id='r-69bqfufi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-925962805',owner_user_name='tempest-TaggedBootDevicesTest-925962805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5dcb591df7446e5b904895723688502',uuid=9f06ae6e-bd11-437e-817c-e245be9afdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converting VIF {"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:27:88,bridge_name='br-int',has_traffic_filtering=True,id=5d77bd19-daa8-4658-94f3-b53ae5852c39,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77bd19-da') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:27:88,bridge_name='br-int',has_traffic_filtering=True,id=5d77bd19-daa8-4658-94f3-b53ae5852c39,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77bd19-da') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d77bd19-da, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f69b4453-a8b4-4ab2-b963-219d5e975701) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:23 user nova-compute[74482]: INFO os_vif [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:27:88,bridge_name='br-int',has_traffic_filtering=True,id=5d77bd19-daa8-4658-94f3-b53ae5852c39,network=Network(35a895e8-90d4-4072-b87a-72a5225609ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d77bd19-da')
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNhRAUBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:20:23 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8358bce3-88b1-4e61-ab3f-6b67836ff646]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:20:23 user nova-compute[74482]: No targets found.
Oct 23 23:20:23 user nova-compute[74482]: iSNS:
Oct 23 23:20:23 user nova-compute[74482]: No targets found.
Oct 23 23:20:23 user nova-compute[74482]: STATIC:
Oct 23 23:20:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:20:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338
Oct 23 23:20:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85
Oct 23 23:20:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:20:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f
Oct 23 23:20:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:23 user nova-compute[74482]: FIRMWARE:
Oct 23 23:20:23 user nova-compute[74482]: No targets found.
Oct 23 23:20:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:20:23 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:20:23 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4bd11d-e8fd-4ae9-9e69-6821ac837586]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: WARNING nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-6c38883d-5612-4b06-928e-e6119b34020b for instance with vm_state active and task_state deleting.
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-unplugged-fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-fb533230-30d2-4006-adf8-60c66ab60fab for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-fb533230-30d2-4006-adf8-60c66ab60fab {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: WARNING nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-fb533230-30d2-4006-adf8-60c66ab60fab for instance with vm_state active and task_state deleting.
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-unplugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: WARNING nova.compute.manager [req-626f6f31-45a2-493e-a6ba-0ba64aa53be7 req-3c5cb1bd-6365-4a3b-8eef-59376e7be708 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-3607096f-a4dc-4f09-9be4-857c5f4cd6bd for instance with vm_state active and task_state deleting.
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[726a1ab7-ce23-4a70-a648-cc443d552be2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:20:23 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:20:23 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:20:23 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:20:23 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:20:23 user nova-compute[74482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 (non-flash)
Oct 23 23:20:23 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:20:23 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:20:23 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c756950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8cfd11-48e2-4108-8c07-e6fa5598fd18]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d08a54-17d1-4248-ab13-54538949201c]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d259fc2b-4053-40c7-b597-abf31d435263]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[203418c8-c969-47c2-aa28-1e920c8309b6]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e1b11d-f0c5-42c9-b455-0fb59c9e94a6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: WARNING nova.compute.manager [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-ede33686-8b6e-46d2-ae50-1c7ecb791d7e for instance with vm_state active and task_state deleting.
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-unplugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: WARNING nova.compute.manager [req-83470045-a4c9-4838-b8ba-185cbc3b93df req-b41e3105-8f60-4f9b-94a2-886804600b86 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-5d77bd19-daa8-4658-94f3-b53ae5852c39 for instance with vm_state active and task_state deleting.
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[868781fd-35e3-4962-b345-e1925fb713ca]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85, portal: 172.16.0.220,3260]
Oct 23 23:20:23 user nova-compute[74482]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85, portal: 172.16.0.220,3260] successful.
Oct 23 23:20:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7de9737f-2bc6-4cfe-96e9-2c4e76171b85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd445e47-81ee-41d2-967f-79ad0e05cda1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] <== disconnect_volume: return (368ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FqwNohUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:20:23 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: WARNING nova.compute.manager [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 for instance with vm_state active and task_state deleting.
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-unplugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-unplugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-plugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] Acquiring lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] No waiting events found dispatching network-vif-plugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:23 user nova-compute[74482]: WARNING nova.compute.manager [req-8d3cec34-155b-42fc-b0a7-d0c990ab65b7 req-fa2e54ea-c07f-44fb-bf18-e589bb9aa9df service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received unexpected event network-vif-plugged-f88eff13-8f21-42b1-ac4f-6976acf42ed7 for instance with vm_state active and task_state deleting.
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[100426c4-5a3e-4404-83bd-1863431f0f15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:20:23 user nova-compute[74482]: No targets found.
Oct 23 23:20:23 user nova-compute[74482]: iSNS:
Oct 23 23:20:23 user nova-compute[74482]: No targets found.
Oct 23 23:20:23 user nova-compute[74482]: STATIC:
Oct 23 23:20:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:20:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338
Oct 23 23:20:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:20:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f
Oct 23 23:20:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:23 user nova-compute[74482]: FIRMWARE:
Oct 23 23:20:23 user nova-compute[74482]: No targets found.
Oct 23 23:20:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:20:23 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:20:23 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:20:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fce56e-fb75-42ba-8d39-dd5c217ac7d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ace2ea-1986-4ca7-a7a7-4d25198543f9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30842c1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f'): ({'sdd'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Removing single pathed devices sdd {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda72678-15a8-470a-b9de-acba388b4276]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1a4e7-eae3-4cec-b1a4-72a06f478403]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Flushing IO for device /dev/sdd {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab45bf51-e5a8-4292-992d-2ee70bf7a0ad]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b088c4f-1780-49be-879b-88c00c81fa62]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50375e49-e128-4d53-900b-76120d45abe1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3657bbe5-7b12-48d3-88ed-1b4d23db5dad]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f, portal: 172.16.0.220,3260]
Oct 23 23:20:24 user nova-compute[74482]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f, portal: 172.16.0.220,3260] successful.
Oct 23 23:20:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68617071-77df-4687-a814-6cf81c1ced9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a87e6e8-4d86-4c6e-99a8-e1773365e62d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.762s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] <== disconnect_volume: return (763ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecQfsazK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:20:24 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc37342f-3938-4415-abab-3023fe8aa358]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:20:24 user nova-compute[74482]: No targets found.
Oct 23 23:20:24 user nova-compute[74482]: iSNS:
Oct 23 23:20:24 user nova-compute[74482]: No targets found.
Oct 23 23:20:24 user nova-compute[74482]: STATIC:
Oct 23 23:20:24 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:20:24 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:24 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:24 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338
Oct 23 23:20:24 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:24 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:24 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:20:24 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:24 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:24 user nova-compute[74482]: FIRMWARE:
Oct 23 23:20:24 user nova-compute[74482]: No targets found.
Oct 23 23:20:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:20:24 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:20:24 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c02dbe-25ea-40a0-b395-2a7e13ebe374]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5122aa45-8fac-47dc-89fb-982a30c73938]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30842c1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338'): ({'sdg'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Removing single pathed devices sdg {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7486b68-64db-4b74-b99c-93693694ade0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a78d35-07b7-4e89-a0ee-014c2f9af600]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Flushing IO for device /dev/sdg {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab6a6f-5904-4cf1-b2c4-05cc9368da79]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afc5229-b287-4cad-9001-b5d879d2e301]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] SCSI volumes sdg have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[691e4d6b-c7d4-47b5-9253-fd72d31b700b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cd00af-54f4-4e7a-ac8a-73f23fd8104d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338, portal: 172.16.0.220,3260]
Oct 23 23:20:24 user nova-compute[74482]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338, portal: 172.16.0.220,3260] successful.
Oct 23 23:20:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3fcec09-6620-4f7e-9ce1-87f3fdbcc338 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c0e5a-bb6f-430e-9424-567fc4bcacee]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] <== disconnect_volume: return (312ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:20:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Deleting instance files /opt/stack/data/nova/instances/9f06ae6e-bd11-437e-817c-e245be9afdae_del
Oct 23 23:20:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Deletion of /opt/stack/data/nova/instances/9f06ae6e-bd11-437e-817c-e245be9afdae_del complete
Oct 23 23:20:24 user nova-compute[74482]: INFO nova.compute.manager [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Took 3.82 seconds to destroy the instance on the hypervisor.
Oct 23 23:20:24 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:20:24 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:20:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-38315dc8-5b70-4c00-8d88-b66e1dd46faf req-e9879429-3d2b-4295-82cb-210b1b818572 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-deleted-3607096f-a4dc-4f09-9be4-857c5f4cd6bd {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:26 user nova-compute[74482]: INFO nova.compute.manager [req-38315dc8-5b70-4c00-8d88-b66e1dd46faf req-e9879429-3d2b-4295-82cb-210b1b818572 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Neutron deleted interface 3607096f-a4dc-4f09-9be4-857c5f4cd6bd; detaching it from the instance and deleting it from the info cache
Oct 23 23:20:26 user nova-compute[74482]: DEBUG nova.network.neutron [req-38315dc8-5b70-4c00-8d88-b66e1dd46faf req-e9879429-3d2b-4295-82cb-210b1b818572 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [{"id": "6c38883d-5612-4b06-928e-e6119b34020b", "address": "fa:16:3e:92:b2:c0", "network": {"id": "d892f962-1c0f-4d13-8e64-d6eca45ae04f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1866630875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c38883d-56", "ovs_interfaceid": "6c38883d-5612-4b06-928e-e6119b34020b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "address": "fa:16:3e:32:2b:0a", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapede33686-8b", "ovs_interfaceid": "ede33686-8b6e-46d2-ae50-1c7ecb791d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb533230-30d2-4006-adf8-60c66ab60fab", "address": "fa:16:3e:48:a2:af", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb533230-30", "ovs_interfaceid": "fb533230-30d2-4006-adf8-60c66ab60fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "address": "fa:16:3e:cd:10:ab", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec80ea9-e4", "ovs_interfaceid": "dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "address": "fa:16:3e:b1:88:d6", "network": {"id": "4fbf5170-dcf7-4bd6-9c52-8df070985f00", "bridge": "br-int", "label": "tempest-device-tagging-net1-845864484", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88eff13-8f", "ovs_interfaceid": "f88eff13-8f21-42b1-ac4f-6976acf42ed7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "address": "fa:16:3e:14:27:88", "network": {"id": "35a895e8-90d4-4072-b87a-72a5225609ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-830862037", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7f4563c2e2ad42fa9cb3880a8b628f66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d77bd19-da", "ovs_interfaceid": "5d77bd19-daa8-4658-94f3-b53ae5852c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:20:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-38315dc8-5b70-4c00-8d88-b66e1dd46faf req-e9879429-3d2b-4295-82cb-210b1b818572 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Detach interface failed, port_id=3607096f-a4dc-4f09-9be4-857c5f4cd6bd, reason: Instance 9f06ae6e-bd11-437e-817c-e245be9afdae could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:20:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:27 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:20:27 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Took 3.11 seconds to deallocate network for instance.
Oct 23 23:20:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-80c20aa2-3070-45f0-b223-46cbbd39d58f req-dd10f88c-3188-41c9-901f-ddd2f28e6268 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-deleted-dec80ea9-e4e7-4d1e-9dcd-1ea24e111ed3 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-80c20aa2-3070-45f0-b223-46cbbd39d58f req-dd10f88c-3188-41c9-901f-ddd2f28e6268 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-deleted-6c38883d-5612-4b06-928e-e6119b34020b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-80c20aa2-3070-45f0-b223-46cbbd39d58f req-dd10f88c-3188-41c9-901f-ddd2f28e6268 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-deleted-5d77bd19-daa8-4658-94f3-b53ae5852c39 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-80c20aa2-3070-45f0-b223-46cbbd39d58f req-dd10f88c-3188-41c9-901f-ddd2f28e6268 service nova] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Received event network-vif-deleted-f88eff13-8f21-42b1-ac4f-6976acf42ed7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:20:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:30 user nova-compute[74482]: INFO nova.compute.manager [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] [instance: 9f06ae6e-bd11-437e-817c-e245be9afdae] Took 2.80 seconds to detach 3 volumes for instance.
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:20:30 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:31 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:20:31 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8292MB free_disk=25.12076187133789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.875s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.086s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:31 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Deleted allocations for instance 9f06ae6e-bd11-437e-817c-e245be9afdae
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 127d7315-74d4-4905-b203-67556d26e3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance fa1823b3-f352-4a42-b287-06b9c8efbd58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa45561e-5737-4389-af16-9fe6843d09ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0d0a776b-2956-426b-965a-c57559ae00df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-76e12c70-f3eb-4f19-aa27-ec29d81e6319 tempest-TaggedBootDevicesTest-925962805 tempest-TaggedBootDevicesTest-925962805-project-member] Lock "9f06ae6e-bd11-437e-817c-e245be9afdae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.825s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:20:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:34 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fa1823b3-f352-4a42-b287-06b9c8efbd58 is timed out.
Oct 23 23:20:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully detached device vdb from instance fa1823b3-f352-4a42-b287-06b9c8efbd58 from the live domain config.
Oct 23 23:20:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hczUobex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:20:34 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[53701d81-0199-466f-a748-9d1f7e44aad8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:20:34 user nova-compute[74482]: No targets found.
Oct 23 23:20:34 user nova-compute[74482]: iSNS:
Oct 23 23:20:34 user nova-compute[74482]: No targets found.
Oct 23 23:20:34 user nova-compute[74482]: STATIC:
Oct 23 23:20:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:20:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:34 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011
Oct 23 23:20:34 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:34 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:34 user nova-compute[74482]: FIRMWARE:
Oct 23 23:20:34 user nova-compute[74482]: No targets found.
Oct 23 23:20:34 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:20:34 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:20:34 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[18936f63-5f3a-470f-9291-601ef5407316]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[49705d8d-7177-4276-b8ac-66e52c0cd381]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:20:34 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:34 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 (non-flash)
Oct 23 23:20:34 user nova-compute[74482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:34 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c600f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011'): ({'sde'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Removing single pathed devices sde {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84273b0-0766-4b36-812b-7fd2b490c2fa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea6d966-c563-4728-9ddb-9d2f7f214a13]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Flushing IO for device /dev/sde {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2650a9dd-7bd5-4c25-becf-c5d2b6084b2c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e894937-abae-4274-b762-a46d683d4061]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] SCSI volumes sde have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a5fb16-e543-4b16-9dff-98a98af41576]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb40324-02c0-4fdb-8031-387d8143fa3a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011, portal: 172.16.0.220,3260]
Oct 23 23:20:34 user nova-compute[74482]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011, portal: 172.16.0.220,3260] successful.
Oct 23 23:20:34 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83539a8-e374-4e24-8a5e-489c0e158011 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ba4b8-9a61-4ed0-a11f-a387c3e50e61]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] <== disconnect_volume: return (315ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:20:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:20:35 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'flavor' on Instance uuid fa1823b3-f352-4a42-b287-06b9c8efbd58 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:20:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4349bea0-6735-459f-bdbb-f88dbca9a713 tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.869s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WauEgYZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:20:38 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:20:38 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:20:38 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3917ca4-5a67-4ed9-a94a-2db939772174]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:20:38 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c9ae4d-1fcc-46c8-ad68-a745b5c2297a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68] added
Oct 23 23:20:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ea1410-c72e-4085-8967-19bfd1789be4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baa8f9e-72fa-4c6c-9d16-d55ed51e53a9]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WauEgYZv {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WauEgYZv" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1720b1-30a1-434c-a1cb-24ef83c7ce02]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WauEgYZv'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[015af4bf-81e4-495b-badb-2e30c1cd4836]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5acc559-f433-476b-a1b7-42b52562d940]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b8c2bf-5805-413e-98fd-2eec981a69a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68, portal: 172.16.0.220,3260]
Oct 23 23:20:38 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68, portal: 172.16.0.220,3260] successful.
Oct 23 23:20:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0f4eba-f189-4bf3-9355-5a078077f63d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[39275918-50c6-4f12-8a09-527168225233]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:38 user nova-compute[74482]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 (non-flash)
Oct 23 23:20:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:38 user nova-compute[74482]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 (non-flash)
Oct 23 23:20:38 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9231a0-0427-49ae-b6af-756c7c4c4370]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:20:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WauEgYZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:20:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:20:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23764663337663535', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:20:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764663337663535', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:20:39 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:20:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:20:39 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:20:39 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:20:39 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:20:39 user nova-compute[74482]:   <serial>4aa7bafb-8063-4f70-bdc1-36ce08a8ea68</serial>
Oct 23 23:20:39 user nova-compute[74482]: </disk>
Oct 23 23:20:39 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:20:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:20:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:20:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No VIF found with MAC fa:16:3e:f8:5e:d4, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:20:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4755a4b9-a0f6-4810-bf32-67925686dc3b tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.276s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:42 user nova-compute[74482]: INFO nova.compute.manager [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Detaching volume 4aa7bafb-8063-4f70-bdc1-36ce08a8ea68
Oct 23 23:20:42 user nova-compute[74482]: INFO nova.virt.block_device [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attempting to driver detach volume 4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 from mountpoint /dev/vdb
Oct 23 23:20:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Attempting to detach device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:20:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:20:42 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:20:42 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:20:42 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:20:42 user nova-compute[74482]:   <serial>4aa7bafb-8063-4f70-bdc1-36ce08a8ea68</serial>
Oct 23 23:20:42 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:20:42 user nova-compute[74482]: </disk>
Oct 23 23:20:42 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:20:42 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully detached device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the persistent domain config.
Oct 23 23:20:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:20:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:20:42 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:20:42 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:20:42 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:20:42 user nova-compute[74482]:   <serial>4aa7bafb-8063-4f70-bdc1-36ce08a8ea68</serial>
Oct 23 23:20:42 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:20:42 user nova-compute[74482]: </disk>
Oct 23 23:20:42 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:20:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:43 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:20:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:20:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:20:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:20:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-4ad20fa5-d867-4b3f-a7ef-703bc8a4120e req-6194ccb6-ec28-4a6a-a738-1901edc99f17 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-4ad20fa5-d867-4b3f-a7ef-703bc8a4120e req-6194ccb6-ec28-4a6a-a738-1901edc99f17 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing instance network info cache due to event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:20:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ad20fa5-d867-4b3f-a7ef-703bc8a4120e req-6194ccb6-ec28-4a6a-a738-1901edc99f17 service nova] Acquiring lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:20:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ad20fa5-d867-4b3f-a7ef-703bc8a4120e req-6194ccb6-ec28-4a6a-a738-1901edc99f17 service nova] Acquired lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:20:54 user nova-compute[74482]: DEBUG nova.network.neutron [req-4ad20fa5-d867-4b3f-a7ef-703bc8a4120e req-6194ccb6-ec28-4a6a-a738-1901edc99f17 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:20:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:55 user nova-compute[74482]: INFO nova.compute.manager [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Shelve offloading
Oct 23 23:20:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-4ad20fa5-d867-4b3f-a7ef-703bc8a4120e req-6194ccb6-ec28-4a6a-a738-1901edc99f17 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updated VIF entry in instance network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:20:55 user nova-compute[74482]: DEBUG nova.network.neutron [req-4ad20fa5-d867-4b3f-a7ef-703bc8a4120e req-6194ccb6-ec28-4a6a-a738-1901edc99f17 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating instance_info_cache with network_info: [{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:20:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ad20fa5-d867-4b3f-a7ef-703bc8a4120e req-6194ccb6-ec28-4a6a-a738-1901edc99f17 service nova] Releasing lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:20:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Instance destroyed successfully.
Oct 23 23:20:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquired lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating instance_info_cache with network_info: [{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Releasing lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-unplugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-unplugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:56 user nova-compute[74482]: WARNING nova.compute.manager [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-unplugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state active and task_state shelving.
Oct 23 23:20:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:20:56 user nova-compute[74482]: WARNING nova.compute.manager [req-9c73b138-e8ee-493c-b718-f091e8214ce0 req-ab9f04e9-3a10-4691-9eb7-c82034a16789 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state active and task_state shelving.
Oct 23 23:20:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Instance destroyed successfully.
Oct 23 23:20:57 user nova-compute[74482]: DEBUG nova.objects.instance [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lazy-loading 'resources' on Instance uuid aa45561e-5737-4389-af16-9fe6843d09ec {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1278988678',display_name='tempest-TestShelveInstance-server-1278988678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1278988678',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwsZO8eK2BSSEw92mT0Den4SJx5ndi9FgeD0dfZK/T46kiR/Ld8i85yG7Phxi/Q0LzkGd/zEcyTlfFv9bYx7QKS1kKhWHrwvbzeMS6YcRUtK1Hc/cnHJtD/eszrMCvQrA==',key_name='tempest-TestShelveInstance-346128566',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3126d7b8df44e6bdd79ae3917d3569',ramdisk_id='',reservation_id='r-wpc3ins9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-267030383',owner_user_name='tempest-TestShelveInstance-267030383-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:19:28Z,user_data=None,user_id='ba51e10635554ff5b334776437198975',uuid=aa45561e-5737-4389-af16-9fe6843d09ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converting VIF {"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_vif [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc43a1b97-dc, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffdcf756-61ba-4ad8-9478-b796c81d9a46) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:20:57 user nova-compute[74482]: INFO os_vif [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc')
Oct 23 23:20:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vISYythD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:20:57 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[14501fab-37ba-47fa-8207-84788f577259]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:20:57 user nova-compute[74482]: No targets found.
Oct 23 23:20:57 user nova-compute[74482]: iSNS:
Oct 23 23:20:57 user nova-compute[74482]: No targets found.
Oct 23 23:20:57 user nova-compute[74482]: STATIC:
Oct 23 23:20:57 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:20:57 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:57 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:57 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68
Oct 23 23:20:57 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:20:57 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:20:57 user nova-compute[74482]: FIRMWARE:
Oct 23 23:20:57 user nova-compute[74482]: No targets found.
Oct 23 23:20:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:20:57 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:20:57 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc663cfb-3d34-4b08-9cf0-11836a7c609d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[82335e31-a6ee-4645-b7ad-1cfc447f06ae]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:57 user nova-compute[74482]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 (non-flash)
Oct 23 23:20:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:20:57 user nova-compute[74482]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 (non-flash)
Oct 23 23:20:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308c90ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2'): ({'sdh'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Removing single pathed devices sdh {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a48d07c-1503-4a0a-9305-46b71cd6af90]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff963213-b3e8-4fae-8d24-f97ba1b930f1]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Flushing IO for device /dev/sdh {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[28528801-7430-4e5c-b603-a1523b169c4a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a037c1-1d0a-4c3c-8f4b-285de9e4f6c0]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] SCSI volumes sdh have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[58289a69-6e7e-4c2b-9d71-235229ddd02c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f3e15e-904e-4300-ba68-2f351667e190]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260]
Oct 23 23:20:57 user nova-compute[74482]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260] successful.
Oct 23 23:20:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3f5f08-f5ad-4030-beac-9db0e62a4969]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] <== disconnect_volume: return (289ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:20:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:20:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Deleting instance files /opt/stack/data/nova/instances/aa45561e-5737-4389-af16-9fe6843d09ec_del
Oct 23 23:20:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Deletion of /opt/stack/data/nova/instances/aa45561e-5737-4389-af16-9fe6843d09ec_del complete
Oct 23 23:20:58 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Deleted allocations for instance aa45561e-5737-4389-af16-9fe6843d09ec
Oct 23 23:20:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG nova.objects.instance [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lazy-loading 'numa_topology' on Instance uuid aa45561e-5737-4389-af16-9fe6843d09ec {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG nova.objects.base [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Object Instance<aa45561e-5737-4389-af16-9fe6843d09ec> lazy-loaded attributes: resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-4473ae3e-d65b-4d9b-a4a2-d147b372fca5 req-783ec1ea-d9e0-41a3-8b4a-66b806d18c66 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-4473ae3e-d65b-4d9b-a4a2-d147b372fca5 req-783ec1ea-d9e0-41a3-8b4a-66b806d18c66 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing instance network info cache due to event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4473ae3e-d65b-4d9b-a4a2-d147b372fca5 req-783ec1ea-d9e0-41a3-8b4a-66b806d18c66 service nova] Acquiring lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4473ae3e-d65b-4d9b-a4a2-d147b372fca5 req-783ec1ea-d9e0-41a3-8b4a-66b806d18c66 service nova] Acquired lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG nova.network.neutron [req-4473ae3e-d65b-4d9b-a4a2-d147b372fca5 req-783ec1ea-d9e0-41a3-8b4a-66b806d18c66 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-597c1d01-77e2-4365-a001-4f8e95f5f57d tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.514s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:20:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:20:59 user nova-compute[74482]: DEBUG nova.network.neutron [req-4473ae3e-d65b-4d9b-a4a2-d147b372fca5 req-783ec1ea-d9e0-41a3-8b4a-66b806d18c66 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updated VIF entry in instance network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:20:59 user nova-compute[74482]: DEBUG nova.network.neutron [req-4473ae3e-d65b-4d9b-a4a2-d147b372fca5 req-783ec1ea-d9e0-41a3-8b4a-66b806d18c66 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating instance_info_cache with network_info: [{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": null, "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:20:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4473ae3e-d65b-4d9b-a4a2-d147b372fca5 req-783ec1ea-d9e0-41a3-8b4a-66b806d18c66 service nova] Releasing lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:20:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:03 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 127d7315-74d4-4905-b203-67556d26e3c3 is timed out.
Oct 23 23:21:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully detached device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the live domain config.
Oct 23 23:21:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WauEgYZv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:21:03 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e3c93f-e21a-42be-9bbf-f14957ee8e5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:21:03 user nova-compute[74482]: No targets found.
Oct 23 23:21:03 user nova-compute[74482]: iSNS:
Oct 23 23:21:03 user nova-compute[74482]: No targets found.
Oct 23 23:21:03 user nova-compute[74482]: STATIC:
Oct 23 23:21:03 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68
Oct 23 23:21:03 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:21:03 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:21:03 user nova-compute[74482]: FIRMWARE:
Oct 23 23:21:03 user nova-compute[74482]: No targets found.
Oct 23 23:21:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:21:03 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:21:03 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[65635159-c7d9-4074-8195-ec69b89114dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73813b0-69d5-4781-9e10-56565e65d78b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 (non-flash)
Oct 23 23:21:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 (non-flash)
Oct 23 23:21:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c602440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5896c39b-39a0-488b-9634-cc20b54be241]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b720ef-8aaa-4ad9-bc9a-823a2e81c19c]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1f2775-810b-4772-8c24-94307dc8ff99]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad879ae-274d-4c57-a8d9-4a0ae0b51037]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[506d7b0f-2714-44a9-8e00-7ece0fa013cf]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6adf06-fd25-4579-a750-aa8d0cba1837]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68, portal: 172.16.0.220,3260]
Oct 23 23:21:03 user nova-compute[74482]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68, portal: 172.16.0.220,3260] successful.
Oct 23 23:21:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4aa7bafb-8063-4f70-bdc1-36ce08a8ea68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabbdaba-3979-49ac-a70b-8bafe4704790]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== disconnect_volume: return (296ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:21:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:04 user nova-compute[74482]: DEBUG nova.objects.instance [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:21:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cad80884-de1d-480d-851e-f77c4c582818 tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.892s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:21:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:14 user nova-compute[74482]: INFO nova.compute.manager [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Terminating instance
Oct 23 23:21:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-87fd6a07-6f1b-4ef4-a65a-98a0541a90ed req-1a157d58-b57b-4158-b6c6-ba981c3b09f8 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-unplugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-87fd6a07-6f1b-4ef4-a65a-98a0541a90ed req-1a157d58-b57b-4158-b6c6-ba981c3b09f8 service nova] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-87fd6a07-6f1b-4ef4-a65a-98a0541a90ed req-1a157d58-b57b-4158-b6c6-ba981c3b09f8 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-87fd6a07-6f1b-4ef4-a65a-98a0541a90ed req-1a157d58-b57b-4158-b6c6-ba981c3b09f8 service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-87fd6a07-6f1b-4ef4-a65a-98a0541a90ed req-1a157d58-b57b-4158-b6c6-ba981c3b09f8 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] No waiting events found dispatching network-vif-unplugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-87fd6a07-6f1b-4ef4-a65a-98a0541a90ed req-1a157d58-b57b-4158-b6c6-ba981c3b09f8 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-unplugged-adfd802f-80e5-4834-88c9-112cdb39bd3b for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:21:15 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Instance destroyed successfully.
Oct 23 23:21:15 user nova-compute[74482]: DEBUG nova.objects.instance [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lazy-loading 'resources' on Instance uuid fa1823b3-f352-4a42-b287-06b9c8efbd58 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:15:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-439093387',display_name='tempest-TestMinimumBasicScenario-server-439093387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-439093387',id=29,image_ref='956913ee-f8b8-4cb3-892a-d73d322895e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8tKsf7/m4q47tGDK0K6EF5bBRj0v3mbtODFwxcyPLATcfEvIKQYl/sTLS/2pcgUZox2kzh3mX24uqDuLnuMgyHnJrmqivdSRS8QZU28JeKmWWis0WhsrrQ6hE0msjk7w==',key_name='tempest-TestMinimumBasicScenario-1142816068',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:16:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf59ee373fd04ceda1c9212af985f052',ramdisk_id='',reservation_id='r-pjzv3dhg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='956913ee-f8b8-4cb3-892a-d73d322895e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-964628947',owner_user_name='tempest-TestMinimumBasicScenario-964628947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:18:28Z,user_data=None,user_id='58e1ae75bd484d3ea749e10346671167',uuid=fa1823b3-f352-4a42-b287-06b9c8efbd58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converting VIF {"id": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "address": "fa:16:3e:22:b9:b7", "network": {"id": "7683bc6f-f7af-4c66-afd9-8e02840de0ba", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-745753211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf59ee373fd04ceda1c9212af985f052", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadfd802f-80", "ovs_interfaceid": "adfd802f-80e5-4834-88c9-112cdb39bd3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:b9:b7,bridge_name='br-int',has_traffic_filtering=True,id=adfd802f-80e5-4834-88c9-112cdb39bd3b,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfd802f-80') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG os_vif [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:b9:b7,bridge_name='br-int',has_traffic_filtering=True,id=adfd802f-80e5-4834-88c9-112cdb39bd3b,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfd802f-80') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadfd802f-80, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3f248f7-7dcc-4d7a-9cac-5a2800056a99) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:15 user nova-compute[74482]: INFO os_vif [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:b9:b7,bridge_name='br-int',has_traffic_filtering=True,id=adfd802f-80e5-4834-88c9-112cdb39bd3b,network=Network(7683bc6f-f7af-4c66-afd9-8e02840de0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadfd802f-80')
Oct 23 23:21:15 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Deleting instance files /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58_del
Oct 23 23:21:15 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Deletion of /opt/stack/data/nova/instances/fa1823b3-f352-4a42-b287-06b9c8efbd58_del complete
Oct 23 23:21:15 user nova-compute[74482]: INFO nova.compute.manager [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 23 23:21:15 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:21:15 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:21:16 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Took 0.43 seconds to deallocate network for instance.
Oct 23 23:21:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-7a5ef727-803a-4967-98ee-8213f2c85cd8 req-f3563782-1a13-488e-90a0-f509b0ea33c9 service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-deleted-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:16 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Deleted allocations for instance fa1823b3-f352-4a42-b287-06b9c8efbd58
Oct 23 23:21:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9a450a09-b2a6-4cdb-a7fb-22434114570e tempest-TestMinimumBasicScenario-964628947 tempest-TestMinimumBasicScenario-964628947-project-member] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.795s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:21:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:21:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updating instance_info_cache with network_info: [{"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:21:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:21:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:21:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-7bae5109-6ab8-4bab-8b8e-9a946910a55d req-56ed0355-6719-4d4f-91f9-6e4215d25cfd service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:21:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7bae5109-6ab8-4bab-8b8e-9a946910a55d req-56ed0355-6719-4d4f-91f9-6e4215d25cfd service nova] Acquiring lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7bae5109-6ab8-4bab-8b8e-9a946910a55d req-56ed0355-6719-4d4f-91f9-6e4215d25cfd service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7bae5109-6ab8-4bab-8b8e-9a946910a55d req-56ed0355-6719-4d4f-91f9-6e4215d25cfd service nova] Lock "fa1823b3-f352-4a42-b287-06b9c8efbd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-7bae5109-6ab8-4bab-8b8e-9a946910a55d req-56ed0355-6719-4d4f-91f9-6e4215d25cfd service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] No waiting events found dispatching network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:21:17 user nova-compute[74482]: WARNING nova.compute.manager [req-7bae5109-6ab8-4bab-8b8e-9a946910a55d req-56ed0355-6719-4d4f-91f9-6e4215d25cfd service nova] [instance: fa1823b3-f352-4a42-b287-06b9c8efbd58] Received unexpected event network-vif-plugged-adfd802f-80e5-4834-88c9-112cdb39bd3b for instance with vm_state deleted and task_state None.
Oct 23 23:21:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:21:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:21:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:21:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:33 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:21:33 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:21:33 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=25.136432647705078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 127d7315-74d4-4905-b203-67556d26e3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0d0a776b-2956-426b-965a-c57559ae00df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:21:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:21:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG nova.objects.instance [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:39 user nova-compute[74482]: INFO nova.compute.manager [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attaching volume 2ca0ccfe-6cd8-4634-92eb-e32867689159 to /dev/vdb
Oct 23 23:21:39 user nova-compute[74482]: DEBUG os_brick.utils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9841974a-6dc6-47bf-b8f4-c91cd9decb10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ff9e1-99f7-41c4-9140-863876d80d43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f11f9cc-5196-4eec-94b2-bff57f78a172]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e6d22-54ed-4a63-a1a2-ce6af5b93b6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:21:39 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:21:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[94637110-06ee-4af4-9acd-226b21e28418]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG os_brick.utils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:21:39 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating existing volume attachment record: 559db875-31dc-47a2-922b-1af889a39cf9 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:21:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "0875f84f-7e30-40dc-a00b-08a8cc7169de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:21:44 user nova-compute[74482]: INFO nova.compute.claims [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Claim successful on node user
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:21:44 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.policy [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8af1815fe2604193909609dedcd1925a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34c7b717135415dafd38e0e2eb33e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:21:44 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Creating image(s)
Oct 23 23:21:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "/opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "/opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "/opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.268s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk 1073741824" returned: 0 in 0.061s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Successfully created port: 5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Cannot resize image /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Ensure instance console log exists: /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Successfully updated port: 5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "refresh_cache-0875f84f-7e30-40dc-a00b-08a8cc7169de" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquired lock "refresh_cache-0875f84f-7e30-40dc-a00b-08a8cc7169de" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-6248a889-f1b2-4840-944f-40d92393717c req-44856ae5-ad50-42e6-8ecd-cea31adfc8df service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received event network-changed-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-6248a889-f1b2-4840-944f-40d92393717c req-44856ae5-ad50-42e6-8ecd-cea31adfc8df service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Refreshing instance network info cache due to event network-changed-5df68792-81b0-4187-985e-dba87fa04064. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6248a889-f1b2-4840-944f-40d92393717c req-44856ae5-ad50-42e6-8ecd-cea31adfc8df service nova] Acquiring lock "refresh_cache-0875f84f-7e30-40dc-a00b-08a8cc7169de" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Updating instance_info_cache with network_info: [{"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Releasing lock "refresh_cache-0875f84f-7e30-40dc-a00b-08a8cc7169de" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Instance network_info: |[{"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6248a889-f1b2-4840-944f-40d92393717c req-44856ae5-ad50-42e6-8ecd-cea31adfc8df service nova] Acquired lock "refresh_cache-0875f84f-7e30-40dc-a00b-08a8cc7169de" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.network.neutron [req-6248a889-f1b2-4840-944f-40d92393717c req-44856ae5-ad50-42e6-8ecd-cea31adfc8df service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Refreshing network info cache for port 5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Start _get_guest_xml network_info=[{"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:21:47 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:21:47 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-837465400',display_name='tempest-ServersNegativeTestJSON-server-837465400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-837465400',id=33,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34c7b717135415dafd38e0e2eb33e60',ramdisk_id='',reservation_id='r-66mqafrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-683427977',owner_user_name='tempest-ServersNegativeTestJSON-683427977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:21:45Z,user_data=None,user_id='8af1815fe2604193909609dedcd1925a',uuid=0875f84f-7e30-40dc-a00b-08a8cc7169de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converting VIF {"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:65:2b,bridge_name='br-int',has_traffic_filtering=True,id=5df68792-81b0-4187-985e-dba87fa04064,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df68792-81') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lazy-loading 'pci_devices' on Instance uuid 0875f84f-7e30-40dc-a00b-08a8cc7169de {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:21:47 user nova-compute[74482]:   <uuid>0875f84f-7e30-40dc-a00b-08a8cc7169de</uuid>
Oct 23 23:21:47 user nova-compute[74482]:   <name>instance-00000021</name>
Oct 23 23:21:47 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:21:47 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:21:47 user nova-compute[74482]:   <metadata>
Oct 23 23:21:47 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:21:47 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:21:47 user nova-compute[74482]:       <nova:name>tempest-ServersNegativeTestJSON-server-837465400</nova:name>
Oct 23 23:21:47 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:21:47</nova:creationTime>
Oct 23 23:21:47 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:21:47 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:21:47 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:21:47 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:21:47 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:21:47 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:21:47 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:21:47 user nova-compute[74482]:       <nova:owner>
Oct 23 23:21:47 user nova-compute[74482]:         <nova:user uuid="8af1815fe2604193909609dedcd1925a">tempest-ServersNegativeTestJSON-683427977-project-member</nova:user>
Oct 23 23:21:47 user nova-compute[74482]:         <nova:project uuid="b34c7b717135415dafd38e0e2eb33e60">tempest-ServersNegativeTestJSON-683427977</nova:project>
Oct 23 23:21:47 user nova-compute[74482]:       </nova:owner>
Oct 23 23:21:47 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:21:47 user nova-compute[74482]:       <nova:ports>
Oct 23 23:21:47 user nova-compute[74482]:         <nova:port uuid="5df68792-81b0-4187-985e-dba87fa04064">
Oct 23 23:21:47 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 23:21:47 user nova-compute[74482]:         </nova:port>
Oct 23 23:21:47 user nova-compute[74482]:       </nova:ports>
Oct 23 23:21:47 user nova-compute[74482]:     </nova:instance>
Oct 23 23:21:47 user nova-compute[74482]:   </metadata>
Oct 23 23:21:47 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:21:47 user nova-compute[74482]:     <system>
Oct 23 23:21:47 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:21:47 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:21:47 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:21:47 user nova-compute[74482]:       <entry name="serial">0875f84f-7e30-40dc-a00b-08a8cc7169de</entry>
Oct 23 23:21:47 user nova-compute[74482]:       <entry name="uuid">0875f84f-7e30-40dc-a00b-08a8cc7169de</entry>
Oct 23 23:21:47 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:21:47 user nova-compute[74482]:     </system>
Oct 23 23:21:47 user nova-compute[74482]:   </sysinfo>
Oct 23 23:21:47 user nova-compute[74482]:   <os>
Oct 23 23:21:47 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:21:47 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:21:47 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:21:47 user nova-compute[74482]:   </os>
Oct 23 23:21:47 user nova-compute[74482]:   <features>
Oct 23 23:21:47 user nova-compute[74482]:     <acpi/>
Oct 23 23:21:47 user nova-compute[74482]:     <apic/>
Oct 23 23:21:47 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:21:47 user nova-compute[74482]:   </features>
Oct 23 23:21:47 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:21:47 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:21:47 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:21:47 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:21:47 user nova-compute[74482]:   </clock>
Oct 23 23:21:47 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:21:47 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:21:47 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:21:47 user nova-compute[74482]:   </cpu>
Oct 23 23:21:47 user nova-compute[74482]:   <devices>
Oct 23 23:21:47 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:21:47 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:21:47 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk"/>
Oct 23 23:21:47 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:21:47 user nova-compute[74482]:     </disk>
Oct 23 23:21:47 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:21:47 user nova-compute[74482]:       <mac address="fa:16:3e:21:65:2b"/>
Oct 23 23:21:47 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:21:47 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:21:47 user nova-compute[74482]:       <target dev="tap5df68792-81"/>
Oct 23 23:21:47 user nova-compute[74482]:     </interface>
Oct 23 23:21:47 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:21:47 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/console.log" append="off"/>
Oct 23 23:21:47 user nova-compute[74482]:     </serial>
Oct 23 23:21:47 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:21:47 user nova-compute[74482]:     <video>
Oct 23 23:21:47 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:21:47 user nova-compute[74482]:     </video>
Oct 23 23:21:47 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:21:47 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:21:47 user nova-compute[74482]:     </rng>
Oct 23 23:21:47 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:21:47 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:21:47 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:21:47 user nova-compute[74482]:     </memballoon>
Oct 23 23:21:47 user nova-compute[74482]:   </devices>
Oct 23 23:21:47 user nova-compute[74482]: </domain>
Oct 23 23:21:47 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-837465400',display_name='tempest-ServersNegativeTestJSON-server-837465400',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-837465400',id=33,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b34c7b717135415dafd38e0e2eb33e60',ramdisk_id='',reservation_id='r-66mqafrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-683427977',owner_user_name='tempest-ServersNegativeTestJSON-683427977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:21:45Z,user_data=None,user_id='8af1815fe2604193909609dedcd1925a',uuid=0875f84f-7e30-40dc-a00b-08a8cc7169de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converting VIF {"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:65:2b,bridge_name='br-int',has_traffic_filtering=True,id=5df68792-81b0-4187-985e-dba87fa04064,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df68792-81') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG os_vif [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:65:2b,bridge_name='br-int',has_traffic_filtering=True,id=5df68792-81b0-4187-985e-dba87fa04064,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df68792-81') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '399d40b5-4576-537a-b419-f0127cb4c1e3', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5df68792-81, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5df68792-81, col_values=(('qos', UUID('96910049-27d7-4c26-9428-5b73fd2481b7')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5df68792-81, col_values=(('external_ids', {'iface-id': '5df68792-81b0-4187-985e-dba87fa04064', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:65:2b', 'vm-uuid': '0875f84f-7e30-40dc-a00b-08a8cc7169de'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:21:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:48 user nova-compute[74482]: INFO os_vif [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:65:2b,bridge_name='br-int',has_traffic_filtering=True,id=5df68792-81b0-4187-985e-dba87fa04064,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df68792-81')
Oct 23 23:21:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:21:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] No VIF found with MAC fa:16:3e:21:65:2b, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:21:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-6248a889-f1b2-4840-944f-40d92393717c req-44856ae5-ad50-42e6-8ecd-cea31adfc8df service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Updated VIF entry in instance network info cache for port 5df68792-81b0-4187-985e-dba87fa04064. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:21:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-6248a889-f1b2-4840-944f-40d92393717c req-44856ae5-ad50-42e6-8ecd-cea31adfc8df service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Updating instance_info_cache with network_info: [{"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6248a889-f1b2-4840-944f-40d92393717c req-44856ae5-ad50-42e6-8ecd-cea31adfc8df service nova] Releasing lock "refresh_cache-0875f84f-7e30-40dc-a00b-08a8cc7169de" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-05cf431b-3cf0-46b0-bf00-2e2b7b34dc74 req-c6206020-815d-4cf8-a563-43b065369f9c service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received event network-vif-plugged-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-05cf431b-3cf0-46b0-bf00-2e2b7b34dc74 req-c6206020-815d-4cf8-a563-43b065369f9c service nova] Acquiring lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-05cf431b-3cf0-46b0-bf00-2e2b7b34dc74 req-c6206020-815d-4cf8-a563-43b065369f9c service nova] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-05cf431b-3cf0-46b0-bf00-2e2b7b34dc74 req-c6206020-815d-4cf8-a563-43b065369f9c service nova] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG nova.compute.manager [req-05cf431b-3cf0-46b0-bf00-2e2b7b34dc74 req-c6206020-815d-4cf8-a563-43b065369f9c service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] No waiting events found dispatching network-vif-plugged-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:21:49 user nova-compute[74482]: WARNING nova.compute.manager [req-05cf431b-3cf0-46b0-bf00-2e2b7b34dc74 req-c6206020-815d-4cf8-a563-43b065369f9c service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received unexpected event network-vif-plugged-5df68792-81b0-4187-985e-dba87fa04064 for instance with vm_state building and task_state spawning.
Oct 23 23:21:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquiring lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:21:50 user nova-compute[74482]: INFO nova.compute.claims [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Claim successful on node user
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:21:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.policy [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c92193a7790e4859aa37ec43f450e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528fb88220b243dbbfecda10fe8d06ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:21:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Creating image(s)
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquiring lock "/opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "/opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "/opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.210s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.227s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Successfully created port: 1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk 1073741824" returned: 0 in 0.073s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Cannot resize image /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Ensure instance console log exists: /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Successfully updated port: 1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:21:51 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Instance spawned successfully.
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-89a35a23-35cd-4517-bcc3-ad1a2e4f3c2f req-1ca7ec48-8444-45da-aef6-5d8ccc78e097 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received event network-vif-plugged-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-89a35a23-35cd-4517-bcc3-ad1a2e4f3c2f req-1ca7ec48-8444-45da-aef6-5d8ccc78e097 service nova] Acquiring lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-89a35a23-35cd-4517-bcc3-ad1a2e4f3c2f req-1ca7ec48-8444-45da-aef6-5d8ccc78e097 service nova] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-89a35a23-35cd-4517-bcc3-ad1a2e4f3c2f req-1ca7ec48-8444-45da-aef6-5d8ccc78e097 service nova] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-89a35a23-35cd-4517-bcc3-ad1a2e4f3c2f req-1ca7ec48-8444-45da-aef6-5d8ccc78e097 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] No waiting events found dispatching network-vif-plugged-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:21:51 user nova-compute[74482]: WARNING nova.compute.manager [req-89a35a23-35cd-4517-bcc3-ad1a2e4f3c2f req-1ca7ec48-8444-45da-aef6-5d8ccc78e097 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received unexpected event network-vif-plugged-5df68792-81b0-4187-985e-dba87fa04064 for instance with vm_state building and task_state spawning.
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquiring lock "refresh_cache-af0f7f37-aa59-47fe-bc18-42176d21f9f5" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquired lock "refresh_cache-af0f7f37-aa59-47fe-bc18-42176d21f9f5" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-5044026c-9ced-462c-b7a0-c7dfefa7fac9 req-8d085f22-9c71-4d4a-ab63-8ae80163f544 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received event network-changed-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-5044026c-9ced-462c-b7a0-c7dfefa7fac9 req-8d085f22-9c71-4d4a-ab63-8ae80163f544 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Refreshing instance network info cache due to event network-changed-1b90487b-b4f3-44ae-a041-10f357ec7d7d. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5044026c-9ced-462c-b7a0-c7dfefa7fac9 req-8d085f22-9c71-4d4a-ab63-8ae80163f544 service nova] Acquiring lock "refresh_cache-af0f7f37-aa59-47fe-bc18-42176d21f9f5" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:21:52 user nova-compute[74482]: INFO nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Took 7.22 seconds to spawn the instance on the hypervisor.
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:21:52 user nova-compute[74482]: INFO nova.compute.manager [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Took 7.90 seconds to build instance.
Oct 23 23:21:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4c686fe3-a4ea-4c48-99bb-bd3b3247dc65 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.036s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.network.neutron [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Updating instance_info_cache with network_info: [{"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Releasing lock "refresh_cache-af0f7f37-aa59-47fe-bc18-42176d21f9f5" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Instance network_info: |[{"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5044026c-9ced-462c-b7a0-c7dfefa7fac9 req-8d085f22-9c71-4d4a-ab63-8ae80163f544 service nova] Acquired lock "refresh_cache-af0f7f37-aa59-47fe-bc18-42176d21f9f5" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-5044026c-9ced-462c-b7a0-c7dfefa7fac9 req-8d085f22-9c71-4d4a-ab63-8ae80163f544 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Refreshing network info cache for port 1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Start _get_guest_xml network_info=[{"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:21:52 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:21:52 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:21:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1210981806',display_name='tempest-VolumesActionsTest-instance-1210981806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1210981806',id=34,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='528fb88220b243dbbfecda10fe8d06ae',ramdisk_id='',reservation_id='r-hlfrt31f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1228980977',owner_user_name='tempest-VolumesActionsTest-1228980977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:21:51Z,user_data=None,user_id='c92193a7790e4859aa37ec43f450e2fb',uuid=af0f7f37-aa59-47fe-bc18-42176d21f9f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Converting VIF {"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:07:2c,bridge_name='br-int',has_traffic_filtering=True,id=1b90487b-b4f3-44ae-a041-10f357ec7d7d,network=Network(6f85e231-7dca-4099-8b1a-5d06bb0252b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b90487b-b4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lazy-loading 'pci_devices' on Instance uuid af0f7f37-aa59-47fe-bc18-42176d21f9f5 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:21:52 user nova-compute[74482]:   <uuid>af0f7f37-aa59-47fe-bc18-42176d21f9f5</uuid>
Oct 23 23:21:52 user nova-compute[74482]:   <name>instance-00000022</name>
Oct 23 23:21:52 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:21:52 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:21:52 user nova-compute[74482]:   <metadata>
Oct 23 23:21:52 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:21:52 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:21:52 user nova-compute[74482]:       <nova:name>tempest-VolumesActionsTest-instance-1210981806</nova:name>
Oct 23 23:21:52 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:21:52</nova:creationTime>
Oct 23 23:21:52 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:21:52 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:21:52 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:21:52 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:21:52 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:21:52 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:21:52 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:21:52 user nova-compute[74482]:       <nova:owner>
Oct 23 23:21:52 user nova-compute[74482]:         <nova:user uuid="c92193a7790e4859aa37ec43f450e2fb">tempest-VolumesActionsTest-1228980977-project-member</nova:user>
Oct 23 23:21:52 user nova-compute[74482]:         <nova:project uuid="528fb88220b243dbbfecda10fe8d06ae">tempest-VolumesActionsTest-1228980977</nova:project>
Oct 23 23:21:52 user nova-compute[74482]:       </nova:owner>
Oct 23 23:21:52 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:21:52 user nova-compute[74482]:       <nova:ports>
Oct 23 23:21:52 user nova-compute[74482]:         <nova:port uuid="1b90487b-b4f3-44ae-a041-10f357ec7d7d">
Oct 23 23:21:52 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 23:21:52 user nova-compute[74482]:         </nova:port>
Oct 23 23:21:52 user nova-compute[74482]:       </nova:ports>
Oct 23 23:21:52 user nova-compute[74482]:     </nova:instance>
Oct 23 23:21:52 user nova-compute[74482]:   </metadata>
Oct 23 23:21:52 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:21:52 user nova-compute[74482]:     <system>
Oct 23 23:21:52 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:21:52 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:21:52 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:21:52 user nova-compute[74482]:       <entry name="serial">af0f7f37-aa59-47fe-bc18-42176d21f9f5</entry>
Oct 23 23:21:52 user nova-compute[74482]:       <entry name="uuid">af0f7f37-aa59-47fe-bc18-42176d21f9f5</entry>
Oct 23 23:21:52 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:21:52 user nova-compute[74482]:     </system>
Oct 23 23:21:52 user nova-compute[74482]:   </sysinfo>
Oct 23 23:21:52 user nova-compute[74482]:   <os>
Oct 23 23:21:52 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:21:52 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:21:52 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:21:52 user nova-compute[74482]:   </os>
Oct 23 23:21:52 user nova-compute[74482]:   <features>
Oct 23 23:21:52 user nova-compute[74482]:     <acpi/>
Oct 23 23:21:52 user nova-compute[74482]:     <apic/>
Oct 23 23:21:52 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:21:52 user nova-compute[74482]:   </features>
Oct 23 23:21:52 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:21:52 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:21:52 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:21:52 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:21:52 user nova-compute[74482]:   </clock>
Oct 23 23:21:52 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:21:52 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:21:52 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:21:52 user nova-compute[74482]:   </cpu>
Oct 23 23:21:52 user nova-compute[74482]:   <devices>
Oct 23 23:21:52 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:21:52 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:21:52 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk"/>
Oct 23 23:21:52 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:21:52 user nova-compute[74482]:     </disk>
Oct 23 23:21:52 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:21:52 user nova-compute[74482]:       <mac address="fa:16:3e:02:07:2c"/>
Oct 23 23:21:52 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:21:52 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:21:52 user nova-compute[74482]:       <target dev="tap1b90487b-b4"/>
Oct 23 23:21:52 user nova-compute[74482]:     </interface>
Oct 23 23:21:52 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:21:52 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/console.log" append="off"/>
Oct 23 23:21:52 user nova-compute[74482]:     </serial>
Oct 23 23:21:52 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:21:52 user nova-compute[74482]:     <video>
Oct 23 23:21:52 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:21:52 user nova-compute[74482]:     </video>
Oct 23 23:21:52 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:21:52 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:21:52 user nova-compute[74482]:     </rng>
Oct 23 23:21:52 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:21:52 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:21:52 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:21:52 user nova-compute[74482]:     </memballoon>
Oct 23 23:21:52 user nova-compute[74482]:   </devices>
Oct 23 23:21:52 user nova-compute[74482]: </domain>
Oct 23 23:21:52 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:21:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1210981806',display_name='tempest-VolumesActionsTest-instance-1210981806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1210981806',id=34,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='528fb88220b243dbbfecda10fe8d06ae',ramdisk_id='',reservation_id='r-hlfrt31f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1228980977',owner_user_name='tempest-VolumesActionsTest-1228980977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:21:51Z,user_data=None,user_id='c92193a7790e4859aa37ec43f450e2fb',uuid=af0f7f37-aa59-47fe-bc18-42176d21f9f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Converting VIF {"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:07:2c,bridge_name='br-int',has_traffic_filtering=True,id=1b90487b-b4f3-44ae-a041-10f357ec7d7d,network=Network(6f85e231-7dca-4099-8b1a-5d06bb0252b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b90487b-b4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG os_vif [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:07:2c,bridge_name='br-int',has_traffic_filtering=True,id=1b90487b-b4f3-44ae-a041-10f357ec7d7d,network=Network(6f85e231-7dca-4099-8b1a-5d06bb0252b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b90487b-b4') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40b4412c-7678-55ef-a6f1-eae02e17a844', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b90487b-b4, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b90487b-b4, col_values=(('qos', UUID('8be18a22-4071-4954-9129-652c295a5678')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b90487b-b4, col_values=(('external_ids', {'iface-id': '1b90487b-b4f3-44ae-a041-10f357ec7d7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:07:2c', 'vm-uuid': 'af0f7f37-aa59-47fe-bc18-42176d21f9f5'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:52 user nova-compute[74482]: INFO os_vif [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:07:2c,bridge_name='br-int',has_traffic_filtering=True,id=1b90487b-b4f3-44ae-a041-10f357ec7d7d,network=Network(6f85e231-7dca-4099-8b1a-5d06bb0252b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b90487b-b4')
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] No VIF found with MAC fa:16:3e:02:07:2c, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-5044026c-9ced-462c-b7a0-c7dfefa7fac9 req-8d085f22-9c71-4d4a-ab63-8ae80163f544 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Updated VIF entry in instance network info cache for port 1b90487b-b4f3-44ae-a041-10f357ec7d7d. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-5044026c-9ced-462c-b7a0-c7dfefa7fac9 req-8d085f22-9c71-4d4a-ab63-8ae80163f544 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Updating instance_info_cache with network_info: [{"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:21:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5044026c-9ced-462c-b7a0-c7dfefa7fac9 req-8d085f22-9c71-4d4a-ab63-8ae80163f544 service nova] Releasing lock "refresh_cache-af0f7f37-aa59-47fe-bc18-42176d21f9f5" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-5174bfc1-0d1f-40e8-bd77-d898798facf1 req-e583ce98-26fd-40ac-9ca7-200d6cecc455 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received event network-vif-plugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5174bfc1-0d1f-40e8-bd77-d898798facf1 req-e583ce98-26fd-40ac-9ca7-200d6cecc455 service nova] Acquiring lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5174bfc1-0d1f-40e8-bd77-d898798facf1 req-e583ce98-26fd-40ac-9ca7-200d6cecc455 service nova] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5174bfc1-0d1f-40e8-bd77-d898798facf1 req-e583ce98-26fd-40ac-9ca7-200d6cecc455 service nova] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-5174bfc1-0d1f-40e8-bd77-d898798facf1 req-e583ce98-26fd-40ac-9ca7-200d6cecc455 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] No waiting events found dispatching network-vif-plugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:21:54 user nova-compute[74482]: WARNING nova.compute.manager [req-5174bfc1-0d1f-40e8-bd77-d898798facf1 req-e583ce98-26fd-40ac-9ca7-200d6cecc455 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received unexpected event network-vif-plugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d for instance with vm_state building and task_state spawning.
Oct 23 23:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:21:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Instance spawned successfully.
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:21:56 user nova-compute[74482]: INFO nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Took 6.12 seconds to spawn the instance on the hypervisor.
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-06663678-897c-4aad-b923-d22b0fb51617 req-bdd0586b-e729-4321-b2af-39381acc3064 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received event network-vif-plugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-06663678-897c-4aad-b923-d22b0fb51617 req-bdd0586b-e729-4321-b2af-39381acc3064 service nova] Acquiring lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-06663678-897c-4aad-b923-d22b0fb51617 req-bdd0586b-e729-4321-b2af-39381acc3064 service nova] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-06663678-897c-4aad-b923-d22b0fb51617 req-bdd0586b-e729-4321-b2af-39381acc3064 service nova] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-06663678-897c-4aad-b923-d22b0fb51617 req-bdd0586b-e729-4321-b2af-39381acc3064 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] No waiting events found dispatching network-vif-plugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:21:56 user nova-compute[74482]: WARNING nova.compute.manager [req-06663678-897c-4aad-b923-d22b0fb51617 req-bdd0586b-e729-4321-b2af-39381acc3064 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received unexpected event network-vif-plugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d for instance with vm_state building and task_state spawning.
Oct 23 23:21:56 user nova-compute[74482]: INFO nova.compute.manager [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Took 6.84 seconds to build instance.
Oct 23 23:21:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c836401b-88c8-4f4f-8a02-7d460868b0e5 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.975s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:21:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySAkwxrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:21:59 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:21:59 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:21:59 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a93d82-336b-49b1-bb56-c1ecde00dccf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:21:59 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[30694622-31dc-499d-a093-6103350ab188]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159] added
Oct 23 23:21:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c54a1d-632a-41fe-8096-3e0c5c0fd854]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8425be7-ec85-42b0-a0cb-f8516926cb43]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySAkwxrQ {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySAkwxrQ" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[571b5f39-aacd-4ee6-8bb3-8d2807387f08]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ySAkwxrQ'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a25df9f-f867-498f-bae2-8b7b0a76ae24]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[598189de-b20c-44cf-8a70-b9411170e85f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:21:59 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:21:59 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:21:59 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:21:59 user nova-compute[74482]: 
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8aaea2-f052-4186-b970-4ba8ba1c0cc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159, portal: 172.16.0.220,3260]
Oct 23 23:21:59 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159, portal: 172.16.0.220,3260] successful.
Oct 23 23:21:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfc8878-073c-4a6d-b7ff-c676c354f664]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eba1e04-0e94-4a56-88f2-5a3b3d0ed50b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 (non-flash)
Oct 23 23:21:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 (non-flash)
Oct 23 23:21:59 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[499095da-eb03-46c1-8905-17ce02373f66]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:21:59 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySAkwxrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:22:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:22:00 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26538313063303038', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:22:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538313063303038', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:22:00 user nova-compute[74482]: DEBUG nova.objects.instance [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:22:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:22:00 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:22:00 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:22:00 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:22:00 user nova-compute[74482]:   <serial>2ca0ccfe-6cd8-4634-92eb-e32867689159</serial>
Oct 23 23:22:00 user nova-compute[74482]: </disk>
Oct 23 23:22:00 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:22:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:22:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:22:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] No VIF found with MAC fa:16:3e:f8:5e:d4, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:22:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b77e01c3-6416-4da9-b2a2-1f6c99b2fcbd tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.731s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:22:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:22:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:22:03 user nova-compute[74482]: INFO nova.compute.manager [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Detaching volume 2ca0ccfe-6cd8-4634-92eb-e32867689159
Oct 23 23:22:03 user nova-compute[74482]: INFO nova.virt.block_device [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Attempting to driver detach volume 2ca0ccfe-6cd8-4634-92eb-e32867689159 from mountpoint /dev/vdb
Oct 23 23:22:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Attempting to detach device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:22:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:22:03 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:22:03 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:22:03 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:22:03 user nova-compute[74482]:   <serial>2ca0ccfe-6cd8-4634-92eb-e32867689159</serial>
Oct 23 23:22:03 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:22:03 user nova-compute[74482]: </disk>
Oct 23 23:22:03 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:22:03 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully detached device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the persistent domain config.
Oct 23 23:22:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:22:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:22:03 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:22:03 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:22:03 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:22:03 user nova-compute[74482]:   <serial>2ca0ccfe-6cd8-4634-92eb-e32867689159</serial>
Oct 23 23:22:03 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:22:03 user nova-compute[74482]: </disk>
Oct 23 23:22:03 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:22:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:03 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:22:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating instance_info_cache with network_info: [{"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-127d7315-74d4-4905-b203-67556d26e3c3" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:22:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:22:21 user nova-compute[74482]: INFO nova.compute.claims [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Claim successful on node user
Oct 23 23:22:21 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:22:21 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:22:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:22:21 user nova-compute[74482]: INFO nova.virt.block_device [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Booting with volume 83c54dd7-59ca-4a48-aa37-88a397d864c2 at /dev/vda
Oct 23 23:22:21 user nova-compute[74482]: DEBUG nova.policy [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '240332b3a8c04317b8fe4a6be2d2b0ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7465627b153c4c6c833cecbfbe2aad25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG os_brick.utils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:22:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b19150f-69e6-4e27-8b79-dab3913d661d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3900cc-8ee4-4fcf-80d6-65f125d03274]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e585a0-6c3f-4f10-bef7-150ca9741688]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d7d690-39fa-406f-bbbd-da858d23f629]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:22:22 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:22:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77398a2-9f9e-485a-85e1-789258729d84]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG os_brick.utils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updating existing volume attachment record: 37bc8ee2-4366-4711-8a5d-9bc34677eb06 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Successfully created port: 86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Successfully updated port: 86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquired lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-f5213200-d59a-49db-beb8-06bf1d0602b2 req-ee989800-7624-4f26-b24b-80d8e2fb664c service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-changed-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-f5213200-d59a-49db-beb8-06bf1d0602b2 req-ee989800-7624-4f26-b24b-80d8e2fb664c service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Refreshing instance network info cache due to event network-changed-86c55d34-fb65-4386-b062-6ce8c8fc92d4. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f5213200-d59a-49db-beb8-06bf1d0602b2 req-ee989800-7624-4f26-b24b-80d8e2fb664c service nova] Acquiring lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updating instance_info_cache with network_info: [{"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Releasing lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance network_info: |[{"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f5213200-d59a-49db-beb8-06bf1d0602b2 req-ee989800-7624-4f26-b24b-80d8e2fb664c service nova] Acquired lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-f5213200-d59a-49db-beb8-06bf1d0602b2 req-ee989800-7624-4f26-b24b-80d8e2fb664c service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Refreshing network info cache for port 86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:22:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 127d7315-74d4-4905-b203-67556d26e3c3 is timed out.
Oct 23 23:22:23 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully detached device vdb from instance 127d7315-74d4-4905-b203-67556d26e3c3 from the live domain config.
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySAkwxrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:22:23 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ff7c07-e30b-4f03-8df7-dee97c56f6d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:22:23 user nova-compute[74482]: No targets found.
Oct 23 23:22:23 user nova-compute[74482]: iSNS:
Oct 23 23:22:23 user nova-compute[74482]: No targets found.
Oct 23 23:22:23 user nova-compute[74482]: STATIC:
Oct 23 23:22:23 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159
Oct 23 23:22:23 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:22:23 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:22:23 user nova-compute[74482]: FIRMWARE:
Oct 23 23:22:23 user nova-compute[74482]: No targets found.
Oct 23 23:22:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:22:23 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:22:23 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa9f85b-ddc6-4b86-a946-a2a8a703ba23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a64a088-cf13-4b5c-99a0-bce22466813d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 (non-flash)
Oct 23 23:22:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 (non-flash)
Oct 23 23:22:23 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f304c76bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa12dd1-83e3-4099-8c56-b71672b560cf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d10517a-cb3a-4630-a117-7a51984b49d3]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[692c8703-fbd5-4215-b216-a328a9f4f1af]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-f5213200-d59a-49db-beb8-06bf1d0602b2 req-ee989800-7624-4f26-b24b-80d8e2fb664c service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updated VIF entry in instance network info cache for port 86c55d34-fb65-4386-b062-6ce8c8fc92d4. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-f5213200-d59a-49db-beb8-06bf1d0602b2 req-ee989800-7624-4f26-b24b-80d8e2fb664c service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updating instance_info_cache with network_info: [{"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f5213200-d59a-49db-beb8-06bf1d0602b2 req-ee989800-7624-4f26-b24b-80d8e2fb664c service nova] Releasing lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0be36f-3f2c-400d-a0ea-441e08e2e8d8]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[634a392c-ab98-43b9-9121-313360f900b3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3a53eb-02a0-47c6-9e4b-11df75ab8f81]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159, portal: 172.16.0.220,3260]
Oct 23 23:22:24 user nova-compute[74482]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159, portal: 172.16.0.220,3260] successful.
Oct 23 23:22:24 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca0ccfe-6cd8-4634-92eb-e32867689159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9e6528-83ce-451f-89a1-1198da462384]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] <== disconnect_volume: return (297ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG nova.objects.instance [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'flavor' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:22:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2d5ac4c7-169a-4f9f-80e4-231f132ded4a tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.846s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:22:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:22:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:22:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:22:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:32 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:22:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:22:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:22:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:22:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:22:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:34 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:22:34 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:22:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8315MB free_disk=25.10533905029297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 127d7315-74d4-4905-b203-67556d26e3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0d0a776b-2956-426b-965a-c57559ae00df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0875f84f-7e30-40dc-a00b-08a8cc7169de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance af0f7f37-aa59-47fe-bc18-42176d21f9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:22:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:22:35 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:22:35 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:22:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:22:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:22:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:22:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Creating image(s)
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Ensure instance console log exists: /opt/stack/data/nova/instances/7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Start _get_guest_xml network_info=[{"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EikXHSlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7', 'attached_at': '', 'detached_at': '', 'volume_id': '83c54dd7-59ca-4a48-aa37-88a397d864c2', 'serial': '83c54dd7-59ca-4a48-aa37-88a397d864c2'}, 'disk_bus': 'virtio', 'attachment_id': '37bc8ee2-4366-4711-8a5d-9bc34677eb06', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:22:39 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:22:39 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EikXHSlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:22:39 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:22:39 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:22:39 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce2f754-25e8-495a-92f6-28cd83d3dd26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:22:39 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf31383-4a04-4b01-bda6-c231cc255d97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2] added
Oct 23 23:22:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65bef51-ca85-457c-817f-0d3b155885c6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1531698e-447e-4c4a-9041-f053074cf70b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EikXHSlu {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EikXHSlu" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d39afeb-a778-4027-9ce5-104991a29c8a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EikXHSlu'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb5a58-6e6e-4f47-8edb-54c6d9665f12]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee07975-c1da-4399-8df4-80c6cabd4373]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:22:39 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:22:39 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:22:39 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:22:39 user nova-compute[74482]: 
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e7d619-5c93-4dc0-bac8-927289e699af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260]
Oct 23 23:22:39 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260] successful.
Oct 23 23:22:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5811a7f1-4cd4-4c5e-838d-dd4abc6b99a1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2846109c-4898-4db8-929f-d0875189e6a2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:22:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:22:39 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd1eecf-0190-4dea-89fd-d88498be73b7]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:39 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EikXHSlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23164313836343661', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164313836343661', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-229507823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-229507823',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbCfjYsBkcYTjC7+BvlkhXzn/7Z1vcuaHRl7PKXpwyV0hW5CwN/LsbrsNr0VSCPD6hXKLg03ooJ5WzqujSxNmn8B9jolBMSYogIrdkwx8IIK7QcT7Z5q5+rhClEZV/iZQ==',key_name='tempest-keypair-1256523266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7465627b153c4c6c833cecbfbe2aad25',ramdisk_id='',reservation_id='r-c01l1bfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1658413054',owner_user_name='tempest-ServerActionsV293TestJSON-1658413054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='240332b3a8c04317b8fe4a6be2d2b0ca',uuid=7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converting VIF {"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:22:40 user nova-compute[74482]:   <uuid>7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7</uuid>
Oct 23 23:22:40 user nova-compute[74482]:   <name>instance-00000023</name>
Oct 23 23:22:40 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:22:40 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:22:40 user nova-compute[74482]:   <metadata>
Oct 23 23:22:40 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:22:40 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:22:40 user nova-compute[74482]:       <nova:name>tempest-ServerActionsV293TestJSON-server-229507823</nova:name>
Oct 23 23:22:40 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:22:39</nova:creationTime>
Oct 23 23:22:40 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:22:40 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:22:40 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:22:40 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:22:40 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:22:40 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:22:40 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:22:40 user nova-compute[74482]:       <nova:owner>
Oct 23 23:22:40 user nova-compute[74482]:         <nova:user uuid="240332b3a8c04317b8fe4a6be2d2b0ca">tempest-ServerActionsV293TestJSON-1658413054-project-member</nova:user>
Oct 23 23:22:40 user nova-compute[74482]:         <nova:project uuid="7465627b153c4c6c833cecbfbe2aad25">tempest-ServerActionsV293TestJSON-1658413054</nova:project>
Oct 23 23:22:40 user nova-compute[74482]:       </nova:owner>
Oct 23 23:22:40 user nova-compute[74482]:       <nova:ports>
Oct 23 23:22:40 user nova-compute[74482]:         <nova:port uuid="86c55d34-fb65-4386-b062-6ce8c8fc92d4">
Oct 23 23:22:40 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 23:22:40 user nova-compute[74482]:         </nova:port>
Oct 23 23:22:40 user nova-compute[74482]:       </nova:ports>
Oct 23 23:22:40 user nova-compute[74482]:     </nova:instance>
Oct 23 23:22:40 user nova-compute[74482]:   </metadata>
Oct 23 23:22:40 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:22:40 user nova-compute[74482]:     <system>
Oct 23 23:22:40 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:22:40 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:22:40 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:22:40 user nova-compute[74482]:       <entry name="serial">7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7</entry>
Oct 23 23:22:40 user nova-compute[74482]:       <entry name="uuid">7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7</entry>
Oct 23 23:22:40 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:22:40 user nova-compute[74482]:     </system>
Oct 23 23:22:40 user nova-compute[74482]:   </sysinfo>
Oct 23 23:22:40 user nova-compute[74482]:   <os>
Oct 23 23:22:40 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:22:40 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:22:40 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:22:40 user nova-compute[74482]:   </os>
Oct 23 23:22:40 user nova-compute[74482]:   <features>
Oct 23 23:22:40 user nova-compute[74482]:     <acpi/>
Oct 23 23:22:40 user nova-compute[74482]:     <apic/>
Oct 23 23:22:40 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:22:40 user nova-compute[74482]:   </features>
Oct 23 23:22:40 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:22:40 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:22:40 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:22:40 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:22:40 user nova-compute[74482]:   </clock>
Oct 23 23:22:40 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:22:40 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:22:40 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:22:40 user nova-compute[74482]:   </cpu>
Oct 23 23:22:40 user nova-compute[74482]:   <devices>
Oct 23 23:22:40 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:22:40 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:22:40 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:22:40 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:22:40 user nova-compute[74482]:       <serial>83c54dd7-59ca-4a48-aa37-88a397d864c2</serial>
Oct 23 23:22:40 user nova-compute[74482]:     </disk>
Oct 23 23:22:40 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:22:40 user nova-compute[74482]:       <mac address="fa:16:3e:c4:68:d9"/>
Oct 23 23:22:40 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:22:40 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:22:40 user nova-compute[74482]:       <target dev="tap86c55d34-fb"/>
Oct 23 23:22:40 user nova-compute[74482]:     </interface>
Oct 23 23:22:40 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:22:40 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7/console.log" append="off"/>
Oct 23 23:22:40 user nova-compute[74482]:     </serial>
Oct 23 23:22:40 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:22:40 user nova-compute[74482]:     <video>
Oct 23 23:22:40 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:22:40 user nova-compute[74482]:     </video>
Oct 23 23:22:40 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:22:40 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:22:40 user nova-compute[74482]:     </rng>
Oct 23 23:22:40 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:22:40 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:22:40 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:22:40 user nova-compute[74482]:     </memballoon>
Oct 23 23:22:40 user nova-compute[74482]:   </devices>
Oct 23 23:22:40 user nova-compute[74482]: </domain>
Oct 23 23:22:40 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-229507823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-229507823',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbCfjYsBkcYTjC7+BvlkhXzn/7Z1vcuaHRl7PKXpwyV0hW5CwN/LsbrsNr0VSCPD6hXKLg03ooJ5WzqujSxNmn8B9jolBMSYogIrdkwx8IIK7QcT7Z5q5+rhClEZV/iZQ==',key_name='tempest-keypair-1256523266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7465627b153c4c6c833cecbfbe2aad25',ramdisk_id='',reservation_id='r-c01l1bfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1658413054',owner_user_name='tempest-ServerActionsV293TestJSON-1658413054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='240332b3a8c04317b8fe4a6be2d2b0ca',uuid=7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converting VIF {"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG os_vif [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c912beed-cb1e-549f-918f-42e7ee689f96', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86c55d34-fb, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86c55d34-fb, col_values=(('qos', UUID('04ccd0cd-226e-4f87-a8ab-21e03ced1d99')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86c55d34-fb, col_values=(('external_ids', {'iface-id': '86c55d34-fb65-4386-b062-6ce8c8fc92d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:68:d9', 'vm-uuid': '7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:40 user nova-compute[74482]: INFO os_vif [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb')
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:22:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] No VIF found with MAC fa:16:3e:c4:68:d9, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-37fc4950-725a-4716-9874-222d4a34a763 req-b70d099a-ca03-4dbc-b615-d6a8738226c0 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-37fc4950-725a-4716-9874-222d4a34a763 req-b70d099a-ca03-4dbc-b615-d6a8738226c0 service nova] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-37fc4950-725a-4716-9874-222d4a34a763 req-b70d099a-ca03-4dbc-b615-d6a8738226c0 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-37fc4950-725a-4716-9874-222d4a34a763 req-b70d099a-ca03-4dbc-b615-d6a8738226c0 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-37fc4950-725a-4716-9874-222d4a34a763 req-b70d099a-ca03-4dbc-b615-d6a8738226c0 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] No waiting events found dispatching network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:22:42 user nova-compute[74482]: WARNING nova.compute.manager [req-37fc4950-725a-4716-9874-222d4a34a763 req-b70d099a-ca03-4dbc-b615-d6a8738226c0 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received unexpected event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 for instance with vm_state building and task_state spawning.
Oct 23 23:22:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:22:44 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance spawned successfully.
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-be14dbbf-694f-48ef-9a04-5942a6f5b572 req-cb1eb8c0-3076-4076-8df9-96db711519d1 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-be14dbbf-694f-48ef-9a04-5942a6f5b572 req-cb1eb8c0-3076-4076-8df9-96db711519d1 service nova] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-be14dbbf-694f-48ef-9a04-5942a6f5b572 req-cb1eb8c0-3076-4076-8df9-96db711519d1 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-be14dbbf-694f-48ef-9a04-5942a6f5b572 req-cb1eb8c0-3076-4076-8df9-96db711519d1 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-be14dbbf-694f-48ef-9a04-5942a6f5b572 req-cb1eb8c0-3076-4076-8df9-96db711519d1 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] No waiting events found dispatching network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:22:44 user nova-compute[74482]: WARNING nova.compute.manager [req-be14dbbf-694f-48ef-9a04-5942a6f5b572 req-cb1eb8c0-3076-4076-8df9-96db711519d1 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received unexpected event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 for instance with vm_state building and task_state spawning.
Oct 23 23:22:44 user nova-compute[74482]: INFO nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Took 5.23 seconds to spawn the instance on the hypervisor.
Oct 23 23:22:44 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:22:44 user nova-compute[74482]: INFO nova.compute.manager [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Took 23.30 seconds to build instance.
Oct 23 23:22:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a9b2b044-f819-4310-89ef-e3df1a1b899d tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.398s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:22:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:22:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:22:47 user nova-compute[74482]: INFO nova.compute.manager [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Unshelving
Oct 23 23:22:47 user nova-compute[74482]: INFO nova.virt.block_device [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Booting with volume 13e5ee0d-543d-4151-acf2-f193008c28f2 at /dev/vda
Oct 23 23:22:48 user nova-compute[74482]: DEBUG os_brick.utils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[065f66e2-b954-4aeb-95fc-77c05ae6ad9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7e82c5-f362-464a-aae8-99dca5c1dd7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab91b33-c8f4-49b8-a264-0349e28d404d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cfee9d-2269-4054-9a73-74c10d73a3f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:22:48 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b422fa-5cce-4f9c-838a-d39d49c53f4e]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG os_brick.utils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:22:48 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating existing volume attachment record: 9b157686-147e-474a-accb-341ac0263187 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:22:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:22:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:22:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:22:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:22:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:22:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:22:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:23:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:15 user nova-compute[74482]: DEBUG nova.objects.instance [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lazy-loading 'pci_requests' on Instance uuid aa45561e-5737-4389-af16-9fe6843d09ec {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:23:15 user nova-compute[74482]: DEBUG nova.objects.instance [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lazy-loading 'numa_topology' on Instance uuid aa45561e-5737-4389-af16-9fe6843d09ec {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:23:15 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:23:15 user nova-compute[74482]: INFO nova.compute.claims [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Claim successful on node user
Oct 23 23:23:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:16 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:23:16 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:23:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:16 user nova-compute[74482]: INFO nova.network.neutron [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating port c43a1b97-dc62-4f98-8e7d-14dbff60bb08 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 23:23:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:23:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquired lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:23:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:23:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-db8e7e9f-4b13-49f2-9e2a-4e35f668267f req-b4d6ee23-6d73-4f36-87e2-25b84adf0134 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:23:16 user nova-compute[74482]: DEBUG nova.compute.manager [req-db8e7e9f-4b13-49f2-9e2a-4e35f668267f req-b4d6ee23-6d73-4f36-87e2-25b84adf0134 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing instance network info cache due to event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:23:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-db8e7e9f-4b13-49f2-9e2a-4e35f668267f req-b4d6ee23-6d73-4f36-87e2-25b84adf0134 service nova] Acquiring lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating instance_info_cache with network_info: [{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Releasing lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:23:17 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Creating image(s)
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Ensure instance console log exists: /opt/stack/data/nova/instances/aa45561e-5737-4389-af16-9fe6843d09ec/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Start _get_guest_xml network_info=[{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vISYythD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa45561e-5737-4389-af16-9fe6843d09ec', 'attached_at': '', 'detached_at': '', 'volume_id': '13e5ee0d-543d-4151-acf2-f193008c28f2', 'serial': '13e5ee0d-543d-4151-acf2-f193008c28f2'}, 'disk_bus': 'virtio', 'attachment_id': '9b157686-147e-474a-accb-341ac0263187', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-db8e7e9f-4b13-49f2-9e2a-4e35f668267f req-b4d6ee23-6d73-4f36-87e2-25b84adf0134 service nova] Acquired lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.network.neutron [req-db8e7e9f-4b13-49f2-9e2a-4e35f668267f req-b4d6ee23-6d73-4f36-87e2-25b84adf0134 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:23:17 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:23:17 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.objects.instance [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa45561e-5737-4389-af16-9fe6843d09ec {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.objects.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Object Instance<aa45561e-5737-4389-af16-9fe6843d09ec> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vISYythD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:23:17 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:23:17 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:23:17 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a93234a-b0c5-44f4-a686-cfaf8a79376c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:23:17 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefcd893-f81b-4e24-b01b-32826d2d16f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2] added
Oct 23 23:23:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb5a375-139a-44dd-b633-86c92eeb908e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e9461a-dddc-4d10-a116-dda0f4338d7f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vISYythD {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vISYythD" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b829c4-7ef4-4a04-8e46-5061b2141590]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vISYythD'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3af5da-d7db-41b4-998b-a585a96306ab]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e914ba18-3599-4d5e-aa91-bbbeb2ea2561]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e086-007f-4776-b3ea-f3fa83965967 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e086-007f-4776-b3ea-f3fa83965967 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e086-007f-4776-b3ea-f3fa83965967 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d471712-dc37-4929-9a84-fdebaa3ed41e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260]
Oct 23 23:23:17 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260] successful.
Oct 23 23:23:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7760e50e-8b76-46f8-9a6a-85add12e7b38]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d71a22-2743-4af7-84a4-50618accc29e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e086-007f-4776-b3ea-f3fa83965967 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e086-007f-4776-b3ea-f3fa83965967 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e086-007f-4776-b3ea-f3fa83965967 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:23:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c956b-d1a7-47b7-ad0c-07600c7c365c]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.network.neutron [req-db8e7e9f-4b13-49f2-9e2a-4e35f668267f req-b4d6ee23-6d73-4f36-87e2-25b84adf0134 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updated VIF entry in instance network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG nova.network.neutron [req-db8e7e9f-4b13-49f2-9e2a-4e35f668267f req-b4d6ee23-6d73-4f36-87e2-25b84adf0134 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating instance_info_cache with network_info: [{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:23:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-db8e7e9f-4b13-49f2-9e2a-4e35f668267f req-b4d6ee23-6d73-4f36-87e2-25b84adf0134 service nova] Releasing lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vISYythD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23233663939303039', 'path': '/dev/sdd'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233663939303039', 'path': '/dev/sdd'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1278988678',display_name='tempest-TestShelveInstance-server-1278988678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1278988678',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-346128566',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c3126d7b8df44e6bdd79ae3917d3569',ramdisk_id='',reservation_id='r-wpc3ins9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-267030383',owner_user_name='tempest-TestShelveInstance-267030383-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:22:48Z,user_data=None,user_id='ba51e10635554ff5b334776437198975',uuid=aa45561e-5737-4389-af16-9fe6843d09ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converting VIF {"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.objects.instance [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lazy-loading 'pci_devices' on Instance uuid aa45561e-5737-4389-af16-9fe6843d09ec {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.objects.base [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Object Instance<aa45561e-5737-4389-af16-9fe6843d09ec> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:23:18 user nova-compute[74482]:   <uuid>aa45561e-5737-4389-af16-9fe6843d09ec</uuid>
Oct 23 23:23:18 user nova-compute[74482]:   <name>instance-0000001f</name>
Oct 23 23:23:18 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:23:18 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:23:18 user nova-compute[74482]:   <metadata>
Oct 23 23:23:18 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:23:18 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:23:18 user nova-compute[74482]:       <nova:name>tempest-TestShelveInstance-server-1278988678</nova:name>
Oct 23 23:23:18 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:23:17</nova:creationTime>
Oct 23 23:23:18 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:23:18 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:23:18 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:23:18 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:23:18 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:23:18 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:23:18 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:23:18 user nova-compute[74482]:       <nova:owner>
Oct 23 23:23:18 user nova-compute[74482]:         <nova:user uuid="ba51e10635554ff5b334776437198975">tempest-TestShelveInstance-267030383-project-member</nova:user>
Oct 23 23:23:18 user nova-compute[74482]:         <nova:project uuid="0c3126d7b8df44e6bdd79ae3917d3569">tempest-TestShelveInstance-267030383</nova:project>
Oct 23 23:23:18 user nova-compute[74482]:       </nova:owner>
Oct 23 23:23:18 user nova-compute[74482]:       <nova:ports>
Oct 23 23:23:18 user nova-compute[74482]:         <nova:port uuid="c43a1b97-dc62-4f98-8e7d-14dbff60bb08">
Oct 23 23:23:18 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 23:23:18 user nova-compute[74482]:         </nova:port>
Oct 23 23:23:18 user nova-compute[74482]:       </nova:ports>
Oct 23 23:23:18 user nova-compute[74482]:     </nova:instance>
Oct 23 23:23:18 user nova-compute[74482]:   </metadata>
Oct 23 23:23:18 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:23:18 user nova-compute[74482]:     <system>
Oct 23 23:23:18 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:23:18 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:23:18 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:23:18 user nova-compute[74482]:       <entry name="serial">aa45561e-5737-4389-af16-9fe6843d09ec</entry>
Oct 23 23:23:18 user nova-compute[74482]:       <entry name="uuid">aa45561e-5737-4389-af16-9fe6843d09ec</entry>
Oct 23 23:23:18 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:23:18 user nova-compute[74482]:     </system>
Oct 23 23:23:18 user nova-compute[74482]:   </sysinfo>
Oct 23 23:23:18 user nova-compute[74482]:   <os>
Oct 23 23:23:18 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:23:18 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:23:18 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:23:18 user nova-compute[74482]:   </os>
Oct 23 23:23:18 user nova-compute[74482]:   <features>
Oct 23 23:23:18 user nova-compute[74482]:     <acpi/>
Oct 23 23:23:18 user nova-compute[74482]:     <apic/>
Oct 23 23:23:18 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:23:18 user nova-compute[74482]:   </features>
Oct 23 23:23:18 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:23:18 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:23:18 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:23:18 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:23:18 user nova-compute[74482]:   </clock>
Oct 23 23:23:18 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:23:18 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:23:18 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:23:18 user nova-compute[74482]:   </cpu>
Oct 23 23:23:18 user nova-compute[74482]:   <devices>
Oct 23 23:23:18 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:23:18 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:23:18 user nova-compute[74482]:       <source dev="/dev/sdd"/>
Oct 23 23:23:18 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:23:18 user nova-compute[74482]:       <serial>13e5ee0d-543d-4151-acf2-f193008c28f2</serial>
Oct 23 23:23:18 user nova-compute[74482]:     </disk>
Oct 23 23:23:18 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:23:18 user nova-compute[74482]:       <mac address="fa:16:3e:28:41:da"/>
Oct 23 23:23:18 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:23:18 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:23:18 user nova-compute[74482]:       <target dev="tapc43a1b97-dc"/>
Oct 23 23:23:18 user nova-compute[74482]:     </interface>
Oct 23 23:23:18 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:23:18 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/aa45561e-5737-4389-af16-9fe6843d09ec/console.log" append="off"/>
Oct 23 23:23:18 user nova-compute[74482]:     </serial>
Oct 23 23:23:18 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:23:18 user nova-compute[74482]:     <video>
Oct 23 23:23:18 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:23:18 user nova-compute[74482]:     </video>
Oct 23 23:23:18 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:23:18 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:23:18 user nova-compute[74482]:     </rng>
Oct 23 23:23:18 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:23:18 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:23:18 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:23:18 user nova-compute[74482]:     </memballoon>
Oct 23 23:23:18 user nova-compute[74482]:   </devices>
Oct 23 23:23:18 user nova-compute[74482]: </domain>
Oct 23 23:23:18 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1278988678',display_name='tempest-TestShelveInstance-server-1278988678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1278988678',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-346128566',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0c3126d7b8df44e6bdd79ae3917d3569',ramdisk_id='',reservation_id='r-wpc3ins9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-267030383',owner_user_name='tempest-TestShelveInstance-267030383-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:22:48Z,user_data=None,user_id='ba51e10635554ff5b334776437198975',uuid=aa45561e-5737-4389-af16-9fe6843d09ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converting VIF {"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG os_vif [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46bf91a0-c4b8-5956-b342-687b7391598e', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc43a1b97-dc, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc43a1b97-dc, col_values=(('qos', UUID('a0461607-28a2-43b2-a271-472020d11273')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc43a1b97-dc, col_values=(('external_ids', {'iface-id': 'c43a1b97-dc62-4f98-8e7d-14dbff60bb08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:41:da', 'vm-uuid': 'aa45561e-5737-4389-af16-9fe6843d09ec'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:18 user nova-compute[74482]: INFO os_vif [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc')
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:23:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] No VIF found with MAC fa:16:3e:28:41:da, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-e4f43bd8-95e3-43ca-81c2-0dc0a063e7bf req-9a1dcde8-a5aa-417a-bcc4-83b723cf6633 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e4f43bd8-95e3-43ca-81c2-0dc0a063e7bf req-9a1dcde8-a5aa-417a-bcc4-83b723cf6633 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e4f43bd8-95e3-43ca-81c2-0dc0a063e7bf req-9a1dcde8-a5aa-417a-bcc4-83b723cf6633 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e4f43bd8-95e3-43ca-81c2-0dc0a063e7bf req-9a1dcde8-a5aa-417a-bcc4-83b723cf6633 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-e4f43bd8-95e3-43ca-81c2-0dc0a063e7bf req-9a1dcde8-a5aa-417a-bcc4-83b723cf6633 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:23:20 user nova-compute[74482]: WARNING nova.compute.manager [req-e4f43bd8-95e3-43ca-81c2-0dc0a063e7bf req-9a1dcde8-a5aa-417a-bcc4-83b723cf6633 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 23:23:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:23:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:23:22 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Instance spawned successfully.
Oct 23 23:23:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:23:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-c45ea415-0e9c-4286-9d46-85931250215a req-e3643c49-e2fd-44ba-8e17-36ddea7cf726 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:23:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c45ea415-0e9c-4286-9d46-85931250215a req-e3643c49-e2fd-44ba-8e17-36ddea7cf726 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c45ea415-0e9c-4286-9d46-85931250215a req-e3643c49-e2fd-44ba-8e17-36ddea7cf726 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c45ea415-0e9c-4286-9d46-85931250215a req-e3643c49-e2fd-44ba-8e17-36ddea7cf726 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-c45ea415-0e9c-4286-9d46-85931250215a req-e3643c49-e2fd-44ba-8e17-36ddea7cf726 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:23:22 user nova-compute[74482]: WARNING nova.compute.manager [req-c45ea415-0e9c-4286-9d46-85931250215a req-e3643c49-e2fd-44ba-8e17-36ddea7cf726 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 23:23:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-913aa425-4f57-4220-bcd7-00b717ac024e tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 34.700s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updating instance_info_cache with network_info: [{"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:23:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "0875f84f-7e30-40dc-a00b-08a8cc7169de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:33 user nova-compute[74482]: INFO nova.compute.manager [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Terminating instance
Oct 23 23:23:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-8018a0d1-cafd-404e-9570-3182a2620998 req-0390d415-a60b-4753-b2c6-72aceabfedd2 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received event network-vif-unplugged-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8018a0d1-cafd-404e-9570-3182a2620998 req-0390d415-a60b-4753-b2c6-72aceabfedd2 service nova] Acquiring lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8018a0d1-cafd-404e-9570-3182a2620998 req-0390d415-a60b-4753-b2c6-72aceabfedd2 service nova] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8018a0d1-cafd-404e-9570-3182a2620998 req-0390d415-a60b-4753-b2c6-72aceabfedd2 service nova] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-8018a0d1-cafd-404e-9570-3182a2620998 req-0390d415-a60b-4753-b2c6-72aceabfedd2 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] No waiting events found dispatching network-vif-unplugged-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-8018a0d1-cafd-404e-9570-3182a2620998 req-0390d415-a60b-4753-b2c6-72aceabfedd2 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received event network-vif-unplugged-5df68792-81b0-4187-985e-dba87fa04064 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Instance destroyed successfully.
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.objects.instance [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lazy-loading 'resources' on Instance uuid 0875f84f-7e30-40dc-a00b-08a8cc7169de {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-837465400',display_name='tempest-ServersNegativeTestJSON-server-837465400',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-837465400',id=33,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:21:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b34c7b717135415dafd38e0e2eb33e60',ramdisk_id='',reservation_id='r-66mqafrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-683427977',owner_user_name='tempest-ServersNegativeTestJSON-683427977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:21:52Z,user_data=None,user_id='8af1815fe2604193909609dedcd1925a',uuid=0875f84f-7e30-40dc-a00b-08a8cc7169de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converting VIF {"id": "5df68792-81b0-4187-985e-dba87fa04064", "address": "fa:16:3e:21:65:2b", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df68792-81", "ovs_interfaceid": "5df68792-81b0-4187-985e-dba87fa04064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:65:2b,bridge_name='br-int',has_traffic_filtering=True,id=5df68792-81b0-4187-985e-dba87fa04064,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df68792-81') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG os_vif [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:65:2b,bridge_name='br-int',has_traffic_filtering=True,id=5df68792-81b0-4187-985e-dba87fa04064,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df68792-81') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5df68792-81, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96910049-27d7-4c26-9428-5b73fd2481b7) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:34 user nova-compute[74482]: INFO os_vif [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:65:2b,bridge_name='br-int',has_traffic_filtering=True,id=5df68792-81b0-4187-985e-dba87fa04064,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df68792-81')
Oct 23 23:23:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Deleting instance files /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de_del
Oct 23 23:23:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Deletion of /opt/stack/data/nova/instances/0875f84f-7e30-40dc-a00b-08a8cc7169de_del complete
Oct 23 23:23:34 user nova-compute[74482]: INFO nova.compute.manager [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 23 23:23:34 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:23:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:23:35 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Took 0.80 seconds to deallocate network for instance.
Oct 23 23:23:35 user nova-compute[74482]: DEBUG nova.compute.manager [req-df779f08-4a4c-4814-8d5e-7037b5fbfbcf req-1b7f6dae-6d06-47f3-8f81-fe7252fe6435 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received event network-vif-deleted-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:23:35 user nova-compute[74482]: INFO nova.compute.manager [req-df779f08-4a4c-4814-8d5e-7037b5fbfbcf req-1b7f6dae-6d06-47f3-8f81-fe7252fe6435 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Neutron deleted interface 5df68792-81b0-4187-985e-dba87fa04064; detaching it from the instance and deleting it from the info cache
Oct 23 23:23:35 user nova-compute[74482]: DEBUG nova.network.neutron [req-df779f08-4a4c-4814-8d5e-7037b5fbfbcf req-1b7f6dae-6d06-47f3-8f81-fe7252fe6435 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG nova.compute.manager [req-df779f08-4a4c-4814-8d5e-7037b5fbfbcf req-1b7f6dae-6d06-47f3-8f81-fe7252fe6435 service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Detach interface failed, port_id=5df68792-81b0-4187-985e-dba87fa04064, reason: Instance 0875f84f-7e30-40dc-a00b-08a8cc7169de could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:35 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Deleted allocations for instance 0875f84f-7e30-40dc-a00b-08a8cc7169de
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-55389760-624c-4124-90a2-bfdf2f724766 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-d53dbd57-544a-42d1-bf5b-37034c4b792d req-b716f3b6-5ffd-448e-9e2c-8910df37f2ee service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received event network-vif-plugged-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d53dbd57-544a-42d1-bf5b-37034c4b792d req-b716f3b6-5ffd-448e-9e2c-8910df37f2ee service nova] Acquiring lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d53dbd57-544a-42d1-bf5b-37034c4b792d req-b716f3b6-5ffd-448e-9e2c-8910df37f2ee service nova] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d53dbd57-544a-42d1-bf5b-37034c4b792d req-b716f3b6-5ffd-448e-9e2c-8910df37f2ee service nova] Lock "0875f84f-7e30-40dc-a00b-08a8cc7169de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-d53dbd57-544a-42d1-bf5b-37034c4b792d req-b716f3b6-5ffd-448e-9e2c-8910df37f2ee service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] No waiting events found dispatching network-vif-plugged-5df68792-81b0-4187-985e-dba87fa04064 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:23:36 user nova-compute[74482]: WARNING nova.compute.manager [req-d53dbd57-544a-42d1-bf5b-37034c4b792d req-b716f3b6-5ffd-448e-9e2c-8910df37f2ee service nova] [instance: 0875f84f-7e30-40dc-a00b-08a8cc7169de] Received unexpected event network-vif-plugged-5df68792-81b0-4187-985e-dba87fa04064 for instance with vm_state deleted and task_state None.
Oct 23 23:23:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:23:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8229MB free_disk=25.120624542236328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 127d7315-74d4-4905-b203-67556d26e3c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0d0a776b-2956-426b-965a-c57559ae00df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance af0f7f37-aa59-47fe-bc18-42176d21f9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa45561e-5737-4389-af16-9fe6843d09ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:23:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:23:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:23:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquiring lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquiring lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:56 user nova-compute[74482]: INFO nova.compute.manager [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Terminating instance
Oct 23 23:23:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:23:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-349c2c0c-5f5e-4f05-8e01-1f9aae853610 req-a2a354a7-1001-419e-bf47-5c84f9185276 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received event network-vif-unplugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-349c2c0c-5f5e-4f05-8e01-1f9aae853610 req-a2a354a7-1001-419e-bf47-5c84f9185276 service nova] Acquiring lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-349c2c0c-5f5e-4f05-8e01-1f9aae853610 req-a2a354a7-1001-419e-bf47-5c84f9185276 service nova] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-349c2c0c-5f5e-4f05-8e01-1f9aae853610 req-a2a354a7-1001-419e-bf47-5c84f9185276 service nova] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-349c2c0c-5f5e-4f05-8e01-1f9aae853610 req-a2a354a7-1001-419e-bf47-5c84f9185276 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] No waiting events found dispatching network-vif-unplugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-349c2c0c-5f5e-4f05-8e01-1f9aae853610 req-a2a354a7-1001-419e-bf47-5c84f9185276 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received event network-vif-unplugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:23:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Instance destroyed successfully.
Oct 23 23:23:57 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lazy-loading 'resources' on Instance uuid af0f7f37-aa59-47fe-bc18-42176d21f9f5 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:21:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1210981806',display_name='tempest-VolumesActionsTest-instance-1210981806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1210981806',id=34,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='528fb88220b243dbbfecda10fe8d06ae',ramdisk_id='',reservation_id='r-hlfrt31f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1228980977',owner_user_name='tempest-VolumesActionsTest-1228980977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:21:57Z,user_data=None,user_id='c92193a7790e4859aa37ec43f450e2fb',uuid=af0f7f37-aa59-47fe-bc18-42176d21f9f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Converting VIF {"id": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "address": "fa:16:3e:02:07:2c", "network": {"id": "6f85e231-7dca-4099-8b1a-5d06bb0252b4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-108362649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "528fb88220b243dbbfecda10fe8d06ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b90487b-b4", "ovs_interfaceid": "1b90487b-b4f3-44ae-a041-10f357ec7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:07:2c,bridge_name='br-int',has_traffic_filtering=True,id=1b90487b-b4f3-44ae-a041-10f357ec7d7d,network=Network(6f85e231-7dca-4099-8b1a-5d06bb0252b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b90487b-b4') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG os_vif [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:07:2c,bridge_name='br-int',has_traffic_filtering=True,id=1b90487b-b4f3-44ae-a041-10f357ec7d7d,network=Network(6f85e231-7dca-4099-8b1a-5d06bb0252b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b90487b-b4') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b90487b-b4, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8be18a22-4071-4954-9129-652c295a5678) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:23:57 user nova-compute[74482]: INFO os_vif [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:07:2c,bridge_name='br-int',has_traffic_filtering=True,id=1b90487b-b4f3-44ae-a041-10f357ec7d7d,network=Network(6f85e231-7dca-4099-8b1a-5d06bb0252b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b90487b-b4')
Oct 23 23:23:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Deleting instance files /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5_del
Oct 23 23:23:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Deletion of /opt/stack/data/nova/instances/af0f7f37-aa59-47fe-bc18-42176d21f9f5_del complete
Oct 23 23:23:57 user nova-compute[74482]: INFO nova.compute.manager [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 23 23:23:57 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:23:57 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:23:58 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:23:58 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Took 0.58 seconds to deallocate network for instance.
Oct 23 23:23:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-b5e3693a-d5b6-4856-a202-460dcb419870 req-e83fd621-7940-4288-8c18-9fd9d73a0b77 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received event network-vif-deleted-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:23:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:58 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:23:58 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:23:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:58 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Deleted allocations for instance af0f7f37-aa59-47fe-bc18-42176d21f9f5
Oct 23 23:23:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f9667203-22e6-4f96-b36e-204132a07da9 tempest-VolumesActionsTest-1228980977 tempest-VolumesActionsTest-1228980977-project-member] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.717s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-7b3d2ac1-968b-4c65-b8d9-e831b6547173 req-15015adc-2840-42d0-978b-f2ebaa1d01a8 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received event network-vif-plugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:23:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7b3d2ac1-968b-4c65-b8d9-e831b6547173 req-15015adc-2840-42d0-978b-f2ebaa1d01a8 service nova] Acquiring lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:23:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7b3d2ac1-968b-4c65-b8d9-e831b6547173 req-15015adc-2840-42d0-978b-f2ebaa1d01a8 service nova] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:23:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7b3d2ac1-968b-4c65-b8d9-e831b6547173 req-15015adc-2840-42d0-978b-f2ebaa1d01a8 service nova] Lock "af0f7f37-aa59-47fe-bc18-42176d21f9f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:23:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-7b3d2ac1-968b-4c65-b8d9-e831b6547173 req-15015adc-2840-42d0-978b-f2ebaa1d01a8 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] No waiting events found dispatching network-vif-plugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:23:59 user nova-compute[74482]: WARNING nova.compute.manager [req-7b3d2ac1-968b-4c65-b8d9-e831b6547173 req-15015adc-2840-42d0-978b-f2ebaa1d01a8 service nova] [instance: af0f7f37-aa59-47fe-bc18-42176d21f9f5] Received unexpected event network-vif-plugged-1b90487b-b4f3-44ae-a041-10f357ec7d7d for instance with vm_state deleted and task_state None.
Oct 23 23:24:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-cea95470-ac71-418b-9f7a-953ac282fb89 req-99057c6c-483c-42d8-b18a-793efc584e35 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-changed-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-cea95470-ac71-418b-9f7a-953ac282fb89 req-99057c6c-483c-42d8-b18a-793efc584e35 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Refreshing instance network info cache due to event network-changed-86c55d34-fb65-4386-b062-6ce8c8fc92d4. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:24:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cea95470-ac71-418b-9f7a-953ac282fb89 req-99057c6c-483c-42d8-b18a-793efc584e35 service nova] Acquiring lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:24:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cea95470-ac71-418b-9f7a-953ac282fb89 req-99057c6c-483c-42d8-b18a-793efc584e35 service nova] Acquired lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:24:12 user nova-compute[74482]: DEBUG nova.network.neutron [req-cea95470-ac71-418b-9f7a-953ac282fb89 req-99057c6c-483c-42d8-b18a-793efc584e35 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Refreshing network info cache for port 86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:24:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:12 user nova-compute[74482]: DEBUG nova.network.neutron [req-cea95470-ac71-418b-9f7a-953ac282fb89 req-99057c6c-483c-42d8-b18a-793efc584e35 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updated VIF entry in instance network info cache for port 86c55d34-fb65-4386-b062-6ce8c8fc92d4. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:24:12 user nova-compute[74482]: DEBUG nova.network.neutron [req-cea95470-ac71-418b-9f7a-953ac282fb89 req-99057c6c-483c-42d8-b18a-793efc584e35 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updating instance_info_cache with network_info: [{"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:24:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-cea95470-ac71-418b-9f7a-953ac282fb89 req-99057c6c-483c-42d8-b18a-793efc584e35 service nova] Releasing lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:24:13 user nova-compute[74482]: INFO nova.compute.manager [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Rebuilding instance
Oct 23 23:24:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:24:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-320f53e0-fbec-474c-8c93-bf94150e11dd req-c3e8cf21-2163-4a9d-a18f-c93ec449bf04 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-unplugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-320f53e0-fbec-474c-8c93-bf94150e11dd req-c3e8cf21-2163-4a9d-a18f-c93ec449bf04 service nova] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-320f53e0-fbec-474c-8c93-bf94150e11dd req-c3e8cf21-2163-4a9d-a18f-c93ec449bf04 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-320f53e0-fbec-474c-8c93-bf94150e11dd req-c3e8cf21-2163-4a9d-a18f-c93ec449bf04 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-320f53e0-fbec-474c-8c93-bf94150e11dd req-c3e8cf21-2163-4a9d-a18f-c93ec449bf04 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] No waiting events found dispatching network-vif-unplugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:13 user nova-compute[74482]: WARNING nova.compute.manager [req-320f53e0-fbec-474c-8c93-bf94150e11dd req-c3e8cf21-2163-4a9d-a18f-c93ec449bf04 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received unexpected event network-vif-unplugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 for instance with vm_state active and task_state rebuilding.
Oct 23 23:24:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance destroyed successfully.
Oct 23 23:24:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance destroyed successfully.
Oct 23 23:24:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-924066307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-229507823',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbCfjYsBkcYTjC7+BvlkhXzn/7Z1vcuaHRl7PKXpwyV0hW5CwN/LsbrsNr0VSCPD6hXKLg03ooJ5WzqujSxNmn8B9jolBMSYogIrdkwx8IIK7QcT7Z5q5+rhClEZV/iZQ==',key_name='tempest-keypair-1256523266',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:22:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7465627b153c4c6c833cecbfbe2aad25',ramdisk_id='',reservation_id='r-c01l1bfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1658413054',owner_user_name='tempest-ServerActionsV293TestJSON-1658413054-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:24:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='240332b3a8c04317b8fe4a6be2d2b0ca',uuid=7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converting VIF {"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_vif [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86c55d34-fb, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04ccd0cd-226e-4f87-a8ab-21e03ced1d99) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:14 user nova-compute[74482]: INFO os_vif [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb')
Oct 23 23:24:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EikXHSlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:24:14 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab61b3c9-96c1-4624-8ff9-b763880686ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:24:14 user nova-compute[74482]: No targets found.
Oct 23 23:24:14 user nova-compute[74482]: iSNS:
Oct 23 23:24:14 user nova-compute[74482]: No targets found.
Oct 23 23:24:14 user nova-compute[74482]: STATIC:
Oct 23 23:24:14 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2
Oct 23 23:24:14 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:24:14 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:24:14 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:24:14 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:24:14 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:24:14 user nova-compute[74482]: FIRMWARE:
Oct 23 23:24:14 user nova-compute[74482]: No targets found.
Oct 23 23:24:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:24:14 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:24:14 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a42b75-fddc-4fbb-a5ae-eb5cf97fe14f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f98e50c-833f-44e8-8aa7-bdbc750c80ee]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:24:14 user nova-compute[74482]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:24:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:24:14 user nova-compute[74482]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:24:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c436f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[020aae61-0689-44aa-9347-4801892a5730]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bfa57b-dd99-4211-a722-2bec4dcf273b]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[213fe700-0e1e-4d83-a34e-99ca6bf2cb6b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c475cfee-0431-4eaa-995c-b280ccc00e85]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ab6048ef', '/dev/disk/by-id/scsi-23164313836343661', '/dev/disk/by-id/scsi-1SCST_BIOab6048ef-1d18646ad34a6db2') {{(pid=86306) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 23:24:14 user nova-compute[74482]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ab6048ef
Oct 23 23:24:14 user nova-compute[74482]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23164313836343661
Oct 23 23:24:14 user nova-compute[74482]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOab6048ef-1d18646ad34a6db2
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f7d58-fd74-40cc-a870-d601b174aeec]: (4, None) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3631617-1476-415f-9e34-18eddfa6deba]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b63660c-3cb3-4862-854c-3802e6e9f55b]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260]
Oct 23 23:24:14 user nova-compute[74482]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260] successful.
Oct 23 23:24:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[26de7ea0-44af-4b18-9fab-652afedc5b0f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] <== disconnect_volume: return (318ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:24:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Deleting instance files /opt/stack/data/nova/instances/7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7_del
Oct 23 23:24:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Deletion of /opt/stack/data/nova/instances/7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7_del complete
Oct 23 23:24:14 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 could not be found.
Oct 23 23:24:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EikXHSlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:24:14 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d18235-cb22-4acd-841b-0fddea45cd10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:24:14 user nova-compute[74482]: No targets found.
Oct 23 23:24:14 user nova-compute[74482]: iSNS:
Oct 23 23:24:14 user nova-compute[74482]: No targets found.
Oct 23 23:24:14 user nova-compute[74482]: STATIC:
Oct 23 23:24:14 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:24:14 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:24:14 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:24:14 user nova-compute[74482]: FIRMWARE:
Oct 23 23:24:14 user nova-compute[74482]: No targets found.
Oct 23 23:24:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:24:14 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:24:14 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dc8998-4cfc-4e09-82ce-16420cbe3d47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c044a853-6713-48a7-bcb2-2132aa0483cb]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:24:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:24:14 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c603a30>, {}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Disconnecting from: [] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] <== disconnect_volume: return (67ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:24:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:24:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Preparing to wait for external event volume-reimaged-83c54dd7-59ca-4a48-aa37-88a397d864c2 {{(pid=74482) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 23 23:24:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-28a5ac88-2e02-4aa7-bee6-03e106e0a2cc req-d73d380d-35ce-4987-8fd5-c62c34408f15 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-28a5ac88-2e02-4aa7-bee6-03e106e0a2cc req-d73d380d-35ce-4987-8fd5-c62c34408f15 service nova] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-28a5ac88-2e02-4aa7-bee6-03e106e0a2cc req-d73d380d-35ce-4987-8fd5-c62c34408f15 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-28a5ac88-2e02-4aa7-bee6-03e106e0a2cc req-d73d380d-35ce-4987-8fd5-c62c34408f15 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-28a5ac88-2e02-4aa7-bee6-03e106e0a2cc req-d73d380d-35ce-4987-8fd5-c62c34408f15 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] No event matching network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 in dict_keys([('volume-reimaged', '83c54dd7-59ca-4a48-aa37-88a397d864c2')]) {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Oct 23 23:24:15 user nova-compute[74482]: WARNING nova.compute.manager [req-28a5ac88-2e02-4aa7-bee6-03e106e0a2cc req-d73d380d-35ce-4987-8fd5-c62c34408f15 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received unexpected event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 for instance with vm_state active and task_state rebuilding.
Oct 23 23:24:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:24:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:24:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:24:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:24:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:24:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:24:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:24:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:24:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:24:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:24:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:30 user nova-compute[74482]: INFO nova.compute.manager [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Terminating instance
Oct 23 23:24:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-401639cc-45b3-4945-80a8-88b77ecc2d0b req-604e70c3-7819-421f-beae-36649271da5b service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received event network-vif-unplugged-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-401639cc-45b3-4945-80a8-88b77ecc2d0b req-604e70c3-7819-421f-beae-36649271da5b service nova] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-401639cc-45b3-4945-80a8-88b77ecc2d0b req-604e70c3-7819-421f-beae-36649271da5b service nova] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-401639cc-45b3-4945-80a8-88b77ecc2d0b req-604e70c3-7819-421f-beae-36649271da5b service nova] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-401639cc-45b3-4945-80a8-88b77ecc2d0b req-604e70c3-7819-421f-beae-36649271da5b service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] No waiting events found dispatching network-vif-unplugged-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-401639cc-45b3-4945-80a8-88b77ecc2d0b req-604e70c3-7819-421f-beae-36649271da5b service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received event network-vif-unplugged-fa4e5017-0b5a-4b46-b88b-35253303446c for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:24:31 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Instance destroyed successfully.
Oct 23 23:24:31 user nova-compute[74482]: DEBUG nova.objects.instance [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lazy-loading 'resources' on Instance uuid 127d7315-74d4-4905-b203-67556d26e3c3 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2035983438',display_name='tempest-SnapshotDataIntegrityTests-server-2035983438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2035983438',id=27,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3Jrr4zeyeR5kezuGPYaBTpttUcWtPabF+I2uTrGK8THhlOf4RG8EMDw70nx3iUaXMeEAIitOdKijVTJL9nZArjdX09QFPFW52cNUIBudHJbdB6XoC1GInrENKXiFRwkQ==',key_name='tempest-keypair-429130050',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:15:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c319ace5e2ae44b492554cc7e4365adc',ramdisk_id='',reservation_id='r-dlzvjlac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1098454545',owner_user_name='tempest-SnapshotDataIntegrityTests-1098454545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:15:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b40f4844df3a432aa3f098c2fcfb7d5a',uuid=127d7315-74d4-4905-b203-67556d26e3c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Converting VIF {"id": "fa4e5017-0b5a-4b46-b88b-35253303446c", "address": "fa:16:3e:f8:5e:d4", "network": {"id": "7e6f2082-7aed-4920-9f34-0a3c2138ce65", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265059432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c319ace5e2ae44b492554cc7e4365adc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4e5017-0b", "ovs_interfaceid": "fa4e5017-0b5a-4b46-b88b-35253303446c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:5e:d4,bridge_name='br-int',has_traffic_filtering=True,id=fa4e5017-0b5a-4b46-b88b-35253303446c,network=Network(7e6f2082-7aed-4920-9f34-0a3c2138ce65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4e5017-0b') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG os_vif [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:5e:d4,bridge_name='br-int',has_traffic_filtering=True,id=fa4e5017-0b5a-4b46-b88b-35253303446c,network=Network(7e6f2082-7aed-4920-9f34-0a3c2138ce65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4e5017-0b') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa4e5017-0b, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0eac894e-bb34-42d6-9461-94fce9adfc25) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:31 user nova-compute[74482]: INFO os_vif [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:5e:d4,bridge_name='br-int',has_traffic_filtering=True,id=fa4e5017-0b5a-4b46-b88b-35253303446c,network=Network(7e6f2082-7aed-4920-9f34-0a3c2138ce65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4e5017-0b')
Oct 23 23:24:31 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Deleting instance files /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3_del
Oct 23 23:24:31 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Deletion of /opt/stack/data/nova/instances/127d7315-74d4-4905-b203-67556d26e3c3_del complete
Oct 23 23:24:31 user nova-compute[74482]: INFO nova.compute.manager [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 23:24:31 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:24:31 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:24:32 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:24:32 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Took 1.49 seconds to deallocate network for instance.
Oct 23 23:24:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-7ed3ab6c-02dc-4864-bd79-403d4b3c1f52 req-0fb09fa9-5800-41e6-a2a9-766b9072c45f service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received event network-vif-plugged-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7ed3ab6c-02dc-4864-bd79-403d4b3c1f52 req-0fb09fa9-5800-41e6-a2a9-766b9072c45f service nova] Acquiring lock "127d7315-74d4-4905-b203-67556d26e3c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7ed3ab6c-02dc-4864-bd79-403d4b3c1f52 req-0fb09fa9-5800-41e6-a2a9-766b9072c45f service nova] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7ed3ab6c-02dc-4864-bd79-403d4b3c1f52 req-0fb09fa9-5800-41e6-a2a9-766b9072c45f service nova] Lock "127d7315-74d4-4905-b203-67556d26e3c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-7ed3ab6c-02dc-4864-bd79-403d4b3c1f52 req-0fb09fa9-5800-41e6-a2a9-766b9072c45f service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] No waiting events found dispatching network-vif-plugged-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:33 user nova-compute[74482]: WARNING nova.compute.manager [req-7ed3ab6c-02dc-4864-bd79-403d4b3c1f52 req-0fb09fa9-5800-41e6-a2a9-766b9072c45f service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received unexpected event network-vif-plugged-fa4e5017-0b5a-4b46-b88b-35253303446c for instance with vm_state deleted and task_state None.
Oct 23 23:24:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-7ed3ab6c-02dc-4864-bd79-403d4b3c1f52 req-0fb09fa9-5800-41e6-a2a9-766b9072c45f service nova] [instance: 127d7315-74d4-4905-b203-67556d26e3c3] Received event network-vif-deleted-fa4e5017-0b5a-4b46-b88b-35253303446c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:24:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:33 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Deleted allocations for instance 127d7315-74d4-4905-b203-67556d26e3c3
Oct 23 23:24:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-faa8cca5-eaaf-431d-b917-1c6d43810b0c tempest-SnapshotDataIntegrityTests-1098454545 tempest-SnapshotDataIntegrityTests-1098454545-project-member] Lock "127d7315-74d4-4905-b203-67556d26e3c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:24:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:24:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:24:37 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:24:37 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8527MB free_disk=25.152542114257812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0d0a776b-2956-426b-965a-c57559ae00df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance aa45561e-5737-4389-af16-9fe6843d09ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:24:38 user nova-compute[74482]: INFO nova.compute.claims [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Claim successful on node user
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-0511c66b-49d1-40bc-ad34-89d16fd33f77 req-9e888b0c-7702-4017-965b-4199d3129ac8 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-0511c66b-49d1-40bc-ad34-89d16fd33f77 req-9e888b0c-7702-4017-965b-4199d3129ac8 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing instance network info cache due to event network-changed-c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0511c66b-49d1-40bc-ad34-89d16fd33f77 req-9e888b0c-7702-4017-965b-4199d3129ac8 service nova] Acquiring lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0511c66b-49d1-40bc-ad34-89d16fd33f77 req-9e888b0c-7702-4017-965b-4199d3129ac8 service nova] Acquired lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.network.neutron [req-0511c66b-49d1-40bc-ad34-89d16fd33f77 req-9e888b0c-7702-4017-965b-4199d3129ac8 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Refreshing network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.network.neutron [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:24:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:38 user nova-compute[74482]: INFO nova.compute.manager [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Terminating instance
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:24:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.policy [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0116074d6f0849a3b5e37f7dd649e1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458da81d7c1042a48fb69438dfcc7578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:24:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Creating image(s)
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "/opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "/opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "/opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.047s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.201s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk 1073741824" returned: 0 in 0.075s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Instance destroyed successfully.
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.objects.instance [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lazy-loading 'resources' on Instance uuid aa45561e-5737-4389-af16-9fe6843d09ec {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1278988678',display_name='tempest-TestShelveInstance-server-1278988678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1278988678',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwsZO8eK2BSSEw92mT0Den4SJx5ndi9FgeD0dfZK/T46kiR/Ld8i85yG7Phxi/Q0LzkGd/zEcyTlfFv9bYx7QKS1kKhWHrwvbzeMS6YcRUtK1Hc/cnHJtD/eszrMCvQrA==',key_name='tempest-TestShelveInstance-346128566',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:23:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c3126d7b8df44e6bdd79ae3917d3569',ramdisk_id='',reservation_id='r-wpc3ins9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-267030383',owner_user_name='tempest-TestShelveInstance-267030383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:23:23Z,user_data=None,user_id='ba51e10635554ff5b334776437198975',uuid=aa45561e-5737-4389-af16-9fe6843d09ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converting VIF {"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG os_vif [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc43a1b97-dc, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.network.neutron [req-0511c66b-49d1-40bc-ad34-89d16fd33f77 req-9e888b0c-7702-4017-965b-4199d3129ac8 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updated VIF entry in instance network info cache for port c43a1b97-dc62-4f98-8e7d-14dbff60bb08. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.network.neutron [req-0511c66b-49d1-40bc-ad34-89d16fd33f77 req-9e888b0c-7702-4017-965b-4199d3129ac8 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating instance_info_cache with network_info: [{"id": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "address": "fa:16:3e:28:41:da", "network": {"id": "325b6a70-f7fb-4504-81d2-1f4fad1ee4d1", "bridge": "br-int", "label": "tempest-TestShelveInstance-2050254998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c3126d7b8df44e6bdd79ae3917d3569", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43a1b97-dc", "ovs_interfaceid": "c43a1b97-dc62-4f98-8e7d-14dbff60bb08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0461607-28a2-43b2-a271-472020d11273) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:39 user nova-compute[74482]: INFO os_vif [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:41:da,bridge_name='br-int',has_traffic_filtering=True,id=c43a1b97-dc62-4f98-8e7d-14dbff60bb08,network=Network(325b6a70-f7fb-4504-81d2-1f4fad1ee4d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43a1b97-dc')
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vISYythD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:24:39 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:24:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0511c66b-49d1-40bc-ad34-89d16fd33f77 req-9e888b0c-7702-4017-965b-4199d3129ac8 service nova] Releasing lock "refresh_cache-aa45561e-5737-4389-af16-9fe6843d09ec" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.224s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:24:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d298fb51-3929-4632-ae0d-07561c029d4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:24:40 user nova-compute[74482]: No targets found.
Oct 23 23:24:40 user nova-compute[74482]: iSNS:
Oct 23 23:24:40 user nova-compute[74482]: No targets found.
Oct 23 23:24:40 user nova-compute[74482]: STATIC:
Oct 23 23:24:40 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2
Oct 23 23:24:40 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:24:40 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:24:40 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2
Oct 23 23:24:40 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:24:40 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:24:40 user nova-compute[74482]: FIRMWARE:
Oct 23 23:24:40 user nova-compute[74482]: No targets found.
Oct 23 23:24:40 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:24:40 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:24:40 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3c7674-cbc2-4e94-b728-54926bbc9bcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[98011424-17a1-4cf1-8c2a-b6d9727ab99c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:24:40 user nova-compute[74482]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:24:40 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 (non-flash)
Oct 23 23:24:40 user nova-compute[74482]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:24:40 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f304c7c0d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2'): ({'sdd'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Removing single pathed devices sdd {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Successfully created port: 0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da79151-0f53-4bb9-93bb-940952263b5f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[91de5577-f367-4fb0-a422-138352dc49a3]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Flushing IO for device /dev/sdd {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Cannot resize image /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Ensure instance console log exists: /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a396d3-70c8-438f-a07d-46d17d417676]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fc24c3-a657-4873-b6cd-b639ce7d6a50]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] SCSI volumes sdd have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a388dca-eacd-459a-bb18-30098bf3509e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d97a58-c1a7-4965-a847-6b8cd6251651]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260]
Oct 23 23:24:40 user nova-compute[74482]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2, portal: 172.16.0.220,3260] successful.
Oct 23 23:24:40 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e5ee0d-543d-4151-acf2-f193008c28f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c4d48c-e167-494e-9afa-d155ed921d84]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] <== disconnect_volume: return (451ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:24:40 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Deleting instance files /opt/stack/data/nova/instances/aa45561e-5737-4389-af16-9fe6843d09ec_del
Oct 23 23:24:40 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Deletion of /opt/stack/data/nova/instances/aa45561e-5737-4389-af16-9fe6843d09ec_del complete
Oct 23 23:24:40 user nova-compute[74482]: INFO nova.compute.manager [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Took 1.55 seconds to destroy the instance on the hypervisor.
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-unplugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-unplugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-unplugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:40 user nova-compute[74482]: WARNING nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state active and task_state deleting.
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:40 user nova-compute[74482]: WARNING nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state active and task_state deleting.
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:40 user nova-compute[74482]: WARNING nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state active and task_state deleting.
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-unplugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-unplugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-49667b32-31fc-49e6-8012-91f19ae2210c req-8fa804e3-83d4-4f45-92fc-49b9c2ed3e79 service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-unplugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:24:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Successfully updated port: 0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-b349a4f0-6614-4f2b-9c08-8c90ae7a5a6e req-c059da68-2f9e-43a6-977f-9005c7e52484 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received event network-changed-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-b349a4f0-6614-4f2b-9c08-8c90ae7a5a6e req-c059da68-2f9e-43a6-977f-9005c7e52484 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Refreshing instance network info cache due to event network-changed-0c1977fc-d5a6-4955-81c3-fc8125edfa72. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b349a4f0-6614-4f2b-9c08-8c90ae7a5a6e req-c059da68-2f9e-43a6-977f-9005c7e52484 service nova] Acquiring lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b349a4f0-6614-4f2b-9c08-8c90ae7a5a6e req-c059da68-2f9e-43a6-977f-9005c7e52484 service nova] Acquired lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-b349a4f0-6614-4f2b-9c08-8c90ae7a5a6e req-c059da68-2f9e-43a6-977f-9005c7e52484 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Refreshing network info cache for port 0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-b349a4f0-6614-4f2b-9c08-8c90ae7a5a6e req-c059da68-2f9e-43a6-977f-9005c7e52484 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:24:41 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Took 0.69 seconds to deallocate network for instance.
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-b349a4f0-6614-4f2b-9c08-8c90ae7a5a6e req-c059da68-2f9e-43a6-977f-9005c7e52484 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b349a4f0-6614-4f2b-9c08-8c90ae7a5a6e req-c059da68-2f9e-43a6-977f-9005c7e52484 service nova] Releasing lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquired lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Updating instance_info_cache with network_info: [{"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Releasing lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Instance network_info: |[{"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Start _get_guest_xml network_info=[{"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:24:41 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:24:41 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1922042369',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1922042369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1922042',id=36,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnMKFT/vfULos5ABgMGASNNtI5+zWHkNPemsnt9Qf/QuB/7Pe1frEXdGCIjnEACFiK3SOadnyo1WCnKH3AxR/NtByD/eXJlJtNr68rGqt91PJweyA6s+a0F4nhqdSTEnQ==',key_name='tempest-keypair-703343363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='458da81d7c1042a48fb69438dfcc7578',ramdisk_id='',reservation_id='r-73vgqqyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1385176975',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0116074d6f0849a3b5e37f7dd649e1dc',uuid=e95c5295-1725-4b87-8738-52060b895852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Converting VIF {"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:63:19,bridge_name='br-int',has_traffic_filtering=True,id=0c1977fc-d5a6-4955-81c3-fc8125edfa72,network=Network(3e14a05d-41a7-41ac-8f83-4e3f675222cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c1977fc-d5') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.objects.instance [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lazy-loading 'pci_devices' on Instance uuid e95c5295-1725-4b87-8738-52060b895852 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:24:41 user nova-compute[74482]:   <uuid>e95c5295-1725-4b87-8738-52060b895852</uuid>
Oct 23 23:24:41 user nova-compute[74482]:   <name>instance-00000024</name>
Oct 23 23:24:41 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:24:41 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:24:41 user nova-compute[74482]:   <metadata>
Oct 23 23:24:41 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:24:41 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:24:41 user nova-compute[74482]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1922042369</nova:name>
Oct 23 23:24:41 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:24:41</nova:creationTime>
Oct 23 23:24:41 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:24:41 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:24:41 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:24:41 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:24:41 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:24:41 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:24:41 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:24:41 user nova-compute[74482]:       <nova:owner>
Oct 23 23:24:41 user nova-compute[74482]:         <nova:user uuid="0116074d6f0849a3b5e37f7dd649e1dc">tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member</nova:user>
Oct 23 23:24:41 user nova-compute[74482]:         <nova:project uuid="458da81d7c1042a48fb69438dfcc7578">tempest-TestServerVolumeAttachScenarioOldVersion-1385176975</nova:project>
Oct 23 23:24:41 user nova-compute[74482]:       </nova:owner>
Oct 23 23:24:41 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:24:41 user nova-compute[74482]:       <nova:ports>
Oct 23 23:24:41 user nova-compute[74482]:         <nova:port uuid="0c1977fc-d5a6-4955-81c3-fc8125edfa72">
Oct 23 23:24:41 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 23:24:41 user nova-compute[74482]:         </nova:port>
Oct 23 23:24:41 user nova-compute[74482]:       </nova:ports>
Oct 23 23:24:41 user nova-compute[74482]:     </nova:instance>
Oct 23 23:24:41 user nova-compute[74482]:   </metadata>
Oct 23 23:24:41 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:24:41 user nova-compute[74482]:     <system>
Oct 23 23:24:41 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:24:41 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:24:41 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:24:41 user nova-compute[74482]:       <entry name="serial">e95c5295-1725-4b87-8738-52060b895852</entry>
Oct 23 23:24:41 user nova-compute[74482]:       <entry name="uuid">e95c5295-1725-4b87-8738-52060b895852</entry>
Oct 23 23:24:41 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:24:41 user nova-compute[74482]:     </system>
Oct 23 23:24:41 user nova-compute[74482]:   </sysinfo>
Oct 23 23:24:41 user nova-compute[74482]:   <os>
Oct 23 23:24:41 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:24:41 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:24:41 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:24:41 user nova-compute[74482]:   </os>
Oct 23 23:24:41 user nova-compute[74482]:   <features>
Oct 23 23:24:41 user nova-compute[74482]:     <acpi/>
Oct 23 23:24:41 user nova-compute[74482]:     <apic/>
Oct 23 23:24:41 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:24:41 user nova-compute[74482]:   </features>
Oct 23 23:24:41 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:24:41 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:24:41 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:24:41 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:24:41 user nova-compute[74482]:   </clock>
Oct 23 23:24:41 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:24:41 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:24:41 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:24:41 user nova-compute[74482]:   </cpu>
Oct 23 23:24:41 user nova-compute[74482]:   <devices>
Oct 23 23:24:41 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:24:41 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:24:41 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk"/>
Oct 23 23:24:41 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:24:41 user nova-compute[74482]:     </disk>
Oct 23 23:24:41 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:24:41 user nova-compute[74482]:       <mac address="fa:16:3e:5e:63:19"/>
Oct 23 23:24:41 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:24:41 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:24:41 user nova-compute[74482]:       <target dev="tap0c1977fc-d5"/>
Oct 23 23:24:41 user nova-compute[74482]:     </interface>
Oct 23 23:24:41 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:24:41 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/console.log" append="off"/>
Oct 23 23:24:41 user nova-compute[74482]:     </serial>
Oct 23 23:24:41 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:24:41 user nova-compute[74482]:     <video>
Oct 23 23:24:41 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:24:41 user nova-compute[74482]:     </video>
Oct 23 23:24:41 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:24:41 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:24:41 user nova-compute[74482]:     </rng>
Oct 23 23:24:41 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:24:41 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:24:41 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:24:41 user nova-compute[74482]:     </memballoon>
Oct 23 23:24:41 user nova-compute[74482]:   </devices>
Oct 23 23:24:41 user nova-compute[74482]: </domain>
Oct 23 23:24:41 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1922042369',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1922042369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1922042',id=36,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnMKFT/vfULos5ABgMGASNNtI5+zWHkNPemsnt9Qf/QuB/7Pe1frEXdGCIjnEACFiK3SOadnyo1WCnKH3AxR/NtByD/eXJlJtNr68rGqt91PJweyA6s+a0F4nhqdSTEnQ==',key_name='tempest-keypair-703343363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='458da81d7c1042a48fb69438dfcc7578',ramdisk_id='',reservation_id='r-73vgqqyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1385176975',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0116074d6f0849a3b5e37f7dd649e1dc',uuid=e95c5295-1725-4b87-8738-52060b895852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Converting VIF {"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:63:19,bridge_name='br-int',has_traffic_filtering=True,id=0c1977fc-d5a6-4955-81c3-fc8125edfa72,network=Network(3e14a05d-41a7-41ac-8f83-4e3f675222cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c1977fc-d5') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG os_vif [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:63:19,bridge_name='br-int',has_traffic_filtering=True,id=0c1977fc-d5a6-4955-81c3-fc8125edfa72,network=Network(3e14a05d-41a7-41ac-8f83-4e3f675222cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c1977fc-d5') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c49e7a98-7213-5ab8-a639-0ab428680508', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c1977fc-d5, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c1977fc-d5, col_values=(('qos', UUID('cc630d4d-4278-4170-9607-3741773c33ee')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c1977fc-d5, col_values=(('external_ids', {'iface-id': '0c1977fc-d5a6-4955-81c3-fc8125edfa72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:63:19', 'vm-uuid': 'e95c5295-1725-4b87-8738-52060b895852'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:41 user nova-compute[74482]: INFO os_vif [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:63:19,bridge_name='br-int',has_traffic_filtering=True,id=0c1977fc-d5a6-4955-81c3-fc8125edfa72,network=Network(3e14a05d-41a7-41ac-8f83-4e3f675222cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c1977fc-d5')
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:24:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] No VIF found with MAC fa:16:3e:5e:63:19, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:24:42 user nova-compute[74482]: INFO nova.compute.manager [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Took 0.97 seconds to detach 1 volumes for instance.
Oct 23 23:24:42 user nova-compute[74482]: DEBUG nova.compute.manager [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Deleting volume: 13e5ee0d-543d-4151-acf2-f193008c28f2 {{(pid=74482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:42 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Deleted allocations for instance aa45561e-5737-4389-af16-9fe6843d09ec
Oct 23 23:24:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-c4ceb910-591b-4b69-be1c-5b6809a3b7d8 tempest-TestShelveInstance-267030383 tempest-TestShelveInstance-267030383-project-member] Lock "aa45561e-5737-4389-af16-9fe6843d09ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.827s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-3ded6a55-9756-48c9-af99-56b5b9bc4c0c req-155fafc2-1fc4-4fe7-b9a9-633dd2c6f7ef service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3ded6a55-9756-48c9-af99-56b5b9bc4c0c req-155fafc2-1fc4-4fe7-b9a9-633dd2c6f7ef service nova] Acquiring lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3ded6a55-9756-48c9-af99-56b5b9bc4c0c req-155fafc2-1fc4-4fe7-b9a9-633dd2c6f7ef service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3ded6a55-9756-48c9-af99-56b5b9bc4c0c req-155fafc2-1fc4-4fe7-b9a9-633dd2c6f7ef service nova] Lock "aa45561e-5737-4389-af16-9fe6843d09ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-3ded6a55-9756-48c9-af99-56b5b9bc4c0c req-155fafc2-1fc4-4fe7-b9a9-633dd2c6f7ef service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] No waiting events found dispatching network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:42 user nova-compute[74482]: WARNING nova.compute.manager [req-3ded6a55-9756-48c9-af99-56b5b9bc4c0c req-155fafc2-1fc4-4fe7-b9a9-633dd2c6f7ef service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received unexpected event network-vif-plugged-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 for instance with vm_state deleted and task_state None.
Oct 23 23:24:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-3ded6a55-9756-48c9-af99-56b5b9bc4c0c req-155fafc2-1fc4-4fe7-b9a9-633dd2c6f7ef service nova] [instance: aa45561e-5737-4389-af16-9fe6843d09ec] Received event network-vif-deleted-c43a1b97-dc62-4f98-8e7d-14dbff60bb08 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-dabcf999-d562-4f9c-b312-d0e17277648c req-348b6a93-16cb-4ad2-a0e6-0393f7b92423 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received event network-vif-plugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-dabcf999-d562-4f9c-b312-d0e17277648c req-348b6a93-16cb-4ad2-a0e6-0393f7b92423 service nova] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-dabcf999-d562-4f9c-b312-d0e17277648c req-348b6a93-16cb-4ad2-a0e6-0393f7b92423 service nova] Lock "e95c5295-1725-4b87-8738-52060b895852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-dabcf999-d562-4f9c-b312-d0e17277648c req-348b6a93-16cb-4ad2-a0e6-0393f7b92423 service nova] Lock "e95c5295-1725-4b87-8738-52060b895852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:43 user nova-compute[74482]: DEBUG nova.compute.manager [req-dabcf999-d562-4f9c-b312-d0e17277648c req-348b6a93-16cb-4ad2-a0e6-0393f7b92423 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] No waiting events found dispatching network-vif-plugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:43 user nova-compute[74482]: WARNING nova.compute.manager [req-dabcf999-d562-4f9c-b312-d0e17277648c req-348b6a93-16cb-4ad2-a0e6-0393f7b92423 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received unexpected event network-vif-plugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 for instance with vm_state building and task_state spawning.
Oct 23 23:24:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-a384e761-b88c-4d9a-8afd-826602e543c1 req-9280ee99-7532-443d-b2c1-f5fb51102acf service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event volume-reimaged-83c54dd7-59ca-4a48-aa37-88a397d864c2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a384e761-b88c-4d9a-8afd-826602e543c1 req-9280ee99-7532-443d-b2c1-f5fb51102acf service nova] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a384e761-b88c-4d9a-8afd-826602e543c1 req-9280ee99-7532-443d-b2c1-f5fb51102acf service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a384e761-b88c-4d9a-8afd-826602e543c1 req-9280ee99-7532-443d-b2c1-f5fb51102acf service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-a384e761-b88c-4d9a-8afd-826602e543c1 req-9280ee99-7532-443d-b2c1-f5fb51102acf service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Processing event volume-reimaged-83c54dd7-59ca-4a48-aa37-88a397d864c2 {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance event wait completed in 28 seconds for volume-reimaged {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:24:44 user nova-compute[74482]: INFO nova.virt.block_device [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Booting with volume 83c54dd7-59ca-4a48-aa37-88a397d864c2 at /dev/vda
Oct 23 23:24:44 user nova-compute[74482]: DEBUG os_brick.utils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f882bbf-42a7-4f63-aef6-557413c3696b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a091f5f-48b8-480b-906c-a980352108b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e136b268-e8c4-4c20-bf95-81219bbe131f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[accebf6a-ccbb-49a8-84db-2131a1d41653]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:24:44 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:24:44 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7567b722-2c81-459e-b6d9-3c30ced4bd72]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG os_brick.utils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:24:44 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updating existing volume attachment record: 5781406e-b798-40b0-882c-810b052022b9 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-72cf0c93-0761-45c9-806d-e7fdd7a5fee8 req-93ac28fe-e7a8-4e54-98da-fa45d424154a service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received event network-vif-plugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-72cf0c93-0761-45c9-806d-e7fdd7a5fee8 req-93ac28fe-e7a8-4e54-98da-fa45d424154a service nova] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-72cf0c93-0761-45c9-806d-e7fdd7a5fee8 req-93ac28fe-e7a8-4e54-98da-fa45d424154a service nova] Lock "e95c5295-1725-4b87-8738-52060b895852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-72cf0c93-0761-45c9-806d-e7fdd7a5fee8 req-93ac28fe-e7a8-4e54-98da-fa45d424154a service nova] Lock "e95c5295-1725-4b87-8738-52060b895852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-72cf0c93-0761-45c9-806d-e7fdd7a5fee8 req-93ac28fe-e7a8-4e54-98da-fa45d424154a service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] No waiting events found dispatching network-vif-plugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:24:45 user nova-compute[74482]: WARNING nova.compute.manager [req-72cf0c93-0761-45c9-806d-e7fdd7a5fee8 req-93ac28fe-e7a8-4e54-98da-fa45d424154a service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received unexpected event network-vif-plugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 for instance with vm_state building and task_state spawning.
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:24:45 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e95c5295-1725-4b87-8738-52060b895852] Instance spawned successfully.
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:24:45 user nova-compute[74482]: INFO nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Took 6.61 seconds to spawn the instance on the hypervisor.
Oct 23 23:24:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:24:45 user nova-compute[74482]: INFO nova.compute.manager [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Took 7.50 seconds to build instance.
Oct 23 23:24:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-13ca9557-a16d-4b2c-8a10-47b08736d313 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.641s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:24:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:24:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:24:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:25:02 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Creating image(s)
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Ensure instance console log exists: /opt/stack/data/nova/instances/7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Start _get_guest_xml network_info=[{"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EikXHSlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7', 'attached_at': '', 'detached_at': '', 'volume_id': '83c54dd7-59ca-4a48-aa37-88a397d864c2', 'serial': '83c54dd7-59ca-4a48-aa37-88a397d864c2'}, 'disk_bus': 'virtio', 'attachment_id': '5781406e-b798-40b0-882c-810b052022b9', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:25:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 23:25:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EikXHSlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:25:02 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:25:02 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:25:02 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8db5b-9104-4db1-995c-253d11fda6f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:25:02 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9ef96e-4921-403f-9bb1-cc42dc6e5715]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2] added
Oct 23 23:25:02 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da6715c-8a17-47fd-b25b-408ccd461111]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eff575-77c1-4be5-aa3d-31a86471268b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EikXHSlu {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EikXHSlu" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[733380f1-ba68-4a67-aa0a-ae96da821e1b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EikXHSlu'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5295325f-386d-4b8b-901d-8bb5851cce33]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4d0c98-a98e-4f75-852f-30b49f4a8a50]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:25:02 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:25:02 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:25:02 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:25:02 user nova-compute[74482]: : NotImplementedError
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90f5cbb-dd6f-4a8d-8e10-0029e95517fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260]
Oct 23 23:25:02 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260] successful.
Oct 23 23:25:02 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[48109f57-c69c-4f5c-91b1-1d1adf031816]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:25:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dac85ec-73de-447b-82c5-379761c12128]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:25:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:25:03 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e41e48-5a03-446d-898c-f5c9957a7af0]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:25:03 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EikXHSlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23164313836343661', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164313836343661', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-924066307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-229507823',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbCfjYsBkcYTjC7+BvlkhXzn/7Z1vcuaHRl7PKXpwyV0hW5CwN/LsbrsNr0VSCPD6hXKLg03ooJ5WzqujSxNmn8B9jolBMSYogIrdkwx8IIK7QcT7Z5q5+rhClEZV/iZQ==',key_name='tempest-keypair-1256523266',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:22:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7465627b153c4c6c833cecbfbe2aad25',ramdisk_id='',reservation_id='r-c01l1bfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1658413054',owner_user_name='tempest-ServerActionsV293TestJSON-1658413054-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='240332b3a8c04317b8fe4a6be2d2b0ca',uuid=7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converting VIF {"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:25:04 user nova-compute[74482]:   <uuid>7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7</uuid>
Oct 23 23:25:04 user nova-compute[74482]:   <name>instance-00000023</name>
Oct 23 23:25:04 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:25:04 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:25:04 user nova-compute[74482]:   <metadata>
Oct 23 23:25:04 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:25:04 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:25:04 user nova-compute[74482]:       <nova:name>tempest-ServerActionsV293TestJSON-server-924066307</nova:name>
Oct 23 23:25:04 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:25:02</nova:creationTime>
Oct 23 23:25:04 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:25:04 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:25:04 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:25:04 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:25:04 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:25:04 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:25:04 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:25:04 user nova-compute[74482]:       <nova:owner>
Oct 23 23:25:04 user nova-compute[74482]:         <nova:user uuid="240332b3a8c04317b8fe4a6be2d2b0ca">tempest-ServerActionsV293TestJSON-1658413054-project-member</nova:user>
Oct 23 23:25:04 user nova-compute[74482]:         <nova:project uuid="7465627b153c4c6c833cecbfbe2aad25">tempest-ServerActionsV293TestJSON-1658413054</nova:project>
Oct 23 23:25:04 user nova-compute[74482]:       </nova:owner>
Oct 23 23:25:04 user nova-compute[74482]:       <nova:ports>
Oct 23 23:25:04 user nova-compute[74482]:         <nova:port uuid="86c55d34-fb65-4386-b062-6ce8c8fc92d4">
Oct 23 23:25:04 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 23:25:04 user nova-compute[74482]:         </nova:port>
Oct 23 23:25:04 user nova-compute[74482]:       </nova:ports>
Oct 23 23:25:04 user nova-compute[74482]:     </nova:instance>
Oct 23 23:25:04 user nova-compute[74482]:   </metadata>
Oct 23 23:25:04 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:25:04 user nova-compute[74482]:     <system>
Oct 23 23:25:04 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:25:04 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:25:04 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:25:04 user nova-compute[74482]:       <entry name="serial">7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7</entry>
Oct 23 23:25:04 user nova-compute[74482]:       <entry name="uuid">7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7</entry>
Oct 23 23:25:04 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:25:04 user nova-compute[74482]:     </system>
Oct 23 23:25:04 user nova-compute[74482]:   </sysinfo>
Oct 23 23:25:04 user nova-compute[74482]:   <os>
Oct 23 23:25:04 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:25:04 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:25:04 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:25:04 user nova-compute[74482]:   </os>
Oct 23 23:25:04 user nova-compute[74482]:   <features>
Oct 23 23:25:04 user nova-compute[74482]:     <acpi/>
Oct 23 23:25:04 user nova-compute[74482]:     <apic/>
Oct 23 23:25:04 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:25:04 user nova-compute[74482]:   </features>
Oct 23 23:25:04 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:25:04 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:25:04 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:25:04 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:25:04 user nova-compute[74482]:   </clock>
Oct 23 23:25:04 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:25:04 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:25:04 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:25:04 user nova-compute[74482]:   </cpu>
Oct 23 23:25:04 user nova-compute[74482]:   <devices>
Oct 23 23:25:04 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:25:04 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:25:04 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:25:04 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:25:04 user nova-compute[74482]:       <serial>83c54dd7-59ca-4a48-aa37-88a397d864c2</serial>
Oct 23 23:25:04 user nova-compute[74482]:     </disk>
Oct 23 23:25:04 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:25:04 user nova-compute[74482]:       <mac address="fa:16:3e:c4:68:d9"/>
Oct 23 23:25:04 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:25:04 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:25:04 user nova-compute[74482]:       <target dev="tap86c55d34-fb"/>
Oct 23 23:25:04 user nova-compute[74482]:     </interface>
Oct 23 23:25:04 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:25:04 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7/console.log" append="off"/>
Oct 23 23:25:04 user nova-compute[74482]:     </serial>
Oct 23 23:25:04 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:25:04 user nova-compute[74482]:     <video>
Oct 23 23:25:04 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:25:04 user nova-compute[74482]:     </video>
Oct 23 23:25:04 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:25:04 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:25:04 user nova-compute[74482]:     </rng>
Oct 23 23:25:04 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:25:04 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:25:04 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:25:04 user nova-compute[74482]:     </memballoon>
Oct 23 23:25:04 user nova-compute[74482]:   </devices>
Oct 23 23:25:04 user nova-compute[74482]: </domain>
Oct 23 23:25:04 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-924066307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-229507823',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbCfjYsBkcYTjC7+BvlkhXzn/7Z1vcuaHRl7PKXpwyV0hW5CwN/LsbrsNr0VSCPD6hXKLg03ooJ5WzqujSxNmn8B9jolBMSYogIrdkwx8IIK7QcT7Z5q5+rhClEZV/iZQ==',key_name='tempest-keypair-1256523266',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:22:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7465627b153c4c6c833cecbfbe2aad25',ramdisk_id='',reservation_id='r-c01l1bfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1658413054',owner_user_name='tempest-ServerActionsV293TestJSON-1658413054-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='240332b3a8c04317b8fe4a6be2d2b0ca',uuid=7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converting VIF {"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG os_vif [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c912beed-cb1e-549f-918f-42e7ee689f96', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86c55d34-fb, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86c55d34-fb, col_values=(('qos', UUID('2b83f791-c5a8-479b-8ac3-ee800140195f')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86c55d34-fb, col_values=(('external_ids', {'iface-id': '86c55d34-fb65-4386-b062-6ce8c8fc92d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:68:d9', 'vm-uuid': '7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:04 user nova-compute[74482]: INFO os_vif [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb')
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] No VIF found with MAC fa:16:3e:c4:68:d9, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:25:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-a78c0da0-0b3a-432a-933e-6fc1928bdee6 req-d83c1130-ad20-49aa-b20a-07fa6509c9b2 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:25:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a78c0da0-0b3a-432a-933e-6fc1928bdee6 req-d83c1130-ad20-49aa-b20a-07fa6509c9b2 service nova] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a78c0da0-0b3a-432a-933e-6fc1928bdee6 req-d83c1130-ad20-49aa-b20a-07fa6509c9b2 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a78c0da0-0b3a-432a-933e-6fc1928bdee6 req-d83c1130-ad20-49aa-b20a-07fa6509c9b2 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-a78c0da0-0b3a-432a-933e-6fc1928bdee6 req-d83c1130-ad20-49aa-b20a-07fa6509c9b2 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] No waiting events found dispatching network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:25:05 user nova-compute[74482]: WARNING nova.compute.manager [req-a78c0da0-0b3a-432a-933e-6fc1928bdee6 req-d83c1130-ad20-49aa-b20a-07fa6509c9b2 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received unexpected event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 for instance with vm_state active and task_state rebuild_spawning.
Oct 23 23:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:25:07 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance spawned successfully.
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-e1efb48d-8ca1-442f-81bd-f8fa96a4e1e8 req-134e314c-ce42-4988-a48c-fe1e5113aee1 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e1efb48d-8ca1-442f-81bd-f8fa96a4e1e8 req-134e314c-ce42-4988-a48c-fe1e5113aee1 service nova] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e1efb48d-8ca1-442f-81bd-f8fa96a4e1e8 req-134e314c-ce42-4988-a48c-fe1e5113aee1 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e1efb48d-8ca1-442f-81bd-f8fa96a4e1e8 req-134e314c-ce42-4988-a48c-fe1e5113aee1 service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-e1efb48d-8ca1-442f-81bd-f8fa96a4e1e8 req-134e314c-ce42-4988-a48c-fe1e5113aee1 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] No waiting events found dispatching network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:25:07 user nova-compute[74482]: WARNING nova.compute.manager [req-e1efb48d-8ca1-442f-81bd-f8fa96a4e1e8 req-134e314c-ce42-4988-a48c-fe1e5113aee1 service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received unexpected event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 for instance with vm_state active and task_state rebuild_spawning.
Oct 23 23:25:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74482) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 23 23:25:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a384e761-b88c-4d9a-8afd-826602e543c1 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.068s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:25:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:25:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:25:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:25:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:25:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 0d0a776b-2956-426b-965a-c57559ae00df {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:25:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updating instance_info_cache with network_info: [{"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:25:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:25:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:25:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:25:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:25:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:25:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_power_states {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 0d0a776b-2956-426b-965a-c57559ae00df {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid e95c5295-1725-4b87-8738-52060b895852 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "0d0a776b-2956-426b-965a-c57559ae00df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "0d0a776b-2956-426b-965a-c57559ae00df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "e95c5295-1725-4b87-8738-52060b895852" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "e95c5295-1725-4b87-8738-52060b895852" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "0d0a776b-2956-426b-965a-c57559ae00df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:25:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:25:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:38 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:25:38 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8512MB free_disk=25.12352752685547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0d0a776b-2956-426b-965a-c57559ae00df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e95c5295-1725-4b87-8738-52060b895852 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.772s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:25:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:25:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:25:54 user nova-compute[74482]: INFO nova.compute.claims [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Claim successful on node user
Oct 23 23:25:54 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:25:54 user nova-compute[74482]: DEBUG nova.network.neutron [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:25:54 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:25:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG nova.policy [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03405619ccc741db816ae85847d709dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5990acffa754d12b9bb47fc0f44f0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:25:55 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Creating image(s)
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "/opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "/opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "/opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.246s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.195s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk 1073741824" returned: 0 in 0.053s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Successfully created port: 893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Checking if we can resize image /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:25:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Cannot resize image /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Ensure instance console log exists: /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Successfully updated port: 893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquired lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-7f903173-d6a3-4e2b-9e72-21e7fc7ec758 req-441e3600-9fb5-42ff-a07f-6ddab0c8e0bd service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received event network-changed-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-7f903173-d6a3-4e2b-9e72-21e7fc7ec758 req-441e3600-9fb5-42ff-a07f-6ddab0c8e0bd service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Refreshing instance network info cache due to event network-changed-893f5969-9bdd-4417-a50e-425d262ebf33. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7f903173-d6a3-4e2b-9e72-21e7fc7ec758 req-441e3600-9fb5-42ff-a07f-6ddab0c8e0bd service nova] Acquiring lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updating instance_info_cache with network_info: [{"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Releasing lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Instance network_info: |[{"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7f903173-d6a3-4e2b-9e72-21e7fc7ec758 req-441e3600-9fb5-42ff-a07f-6ddab0c8e0bd service nova] Acquired lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.network.neutron [req-7f903173-d6a3-4e2b-9e72-21e7fc7ec758 req-441e3600-9fb5-42ff-a07f-6ddab0c8e0bd service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Refreshing network info cache for port 893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Start _get_guest_xml network_info=[{"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:25:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:25:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:25:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-248313517',display_name='tempest-TestStampPattern-server-248313517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-248313517',id=37,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7YQZm1GfqtZoOS480LjJpdLzFfHr8ohWltRZjWaUsDY7dilvyzekzrkZYBE59rzhwwvndw38f2+LRwrE6/EhfokssEcMuybAOSKBD0XCZ5rgLApMr4Fjos3ZmCSubEKQ==',key_name='tempest-TestStampPattern-726908670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5990acffa754d12b9bb47fc0f44f0e8',ramdisk_id='',reservation_id='r-wmjlr0ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-5890009',owner_user_name='tempest-TestStampPattern-5890009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:25:55Z,user_data=None,user_id='03405619ccc741db816ae85847d709dc',uuid=193ff2db-80a1-406a-95f2-277c798fe86f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converting VIF {"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:68:67,bridge_name='br-int',has_traffic_filtering=True,id=893f5969-9bdd-4417-a50e-425d262ebf33,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893f5969-9b') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.objects.instance [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'pci_devices' on Instance uuid 193ff2db-80a1-406a-95f2-277c798fe86f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:25:57 user nova-compute[74482]:   <uuid>193ff2db-80a1-406a-95f2-277c798fe86f</uuid>
Oct 23 23:25:57 user nova-compute[74482]:   <name>instance-00000025</name>
Oct 23 23:25:57 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:25:57 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:25:57 user nova-compute[74482]:   <metadata>
Oct 23 23:25:57 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:25:57 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:25:57 user nova-compute[74482]:       <nova:name>tempest-TestStampPattern-server-248313517</nova:name>
Oct 23 23:25:57 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:25:56</nova:creationTime>
Oct 23 23:25:57 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:25:57 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:25:57 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:25:57 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:25:57 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:25:57 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:25:57 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:25:57 user nova-compute[74482]:       <nova:owner>
Oct 23 23:25:57 user nova-compute[74482]:         <nova:user uuid="03405619ccc741db816ae85847d709dc">tempest-TestStampPattern-5890009-project-member</nova:user>
Oct 23 23:25:57 user nova-compute[74482]:         <nova:project uuid="f5990acffa754d12b9bb47fc0f44f0e8">tempest-TestStampPattern-5890009</nova:project>
Oct 23 23:25:57 user nova-compute[74482]:       </nova:owner>
Oct 23 23:25:57 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:25:57 user nova-compute[74482]:       <nova:ports>
Oct 23 23:25:57 user nova-compute[74482]:         <nova:port uuid="893f5969-9bdd-4417-a50e-425d262ebf33">
Oct 23 23:25:57 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 23:25:57 user nova-compute[74482]:         </nova:port>
Oct 23 23:25:57 user nova-compute[74482]:       </nova:ports>
Oct 23 23:25:57 user nova-compute[74482]:     </nova:instance>
Oct 23 23:25:57 user nova-compute[74482]:   </metadata>
Oct 23 23:25:57 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:25:57 user nova-compute[74482]:     <system>
Oct 23 23:25:57 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:25:57 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:25:57 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:25:57 user nova-compute[74482]:       <entry name="serial">193ff2db-80a1-406a-95f2-277c798fe86f</entry>
Oct 23 23:25:57 user nova-compute[74482]:       <entry name="uuid">193ff2db-80a1-406a-95f2-277c798fe86f</entry>
Oct 23 23:25:57 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:25:57 user nova-compute[74482]:     </system>
Oct 23 23:25:57 user nova-compute[74482]:   </sysinfo>
Oct 23 23:25:57 user nova-compute[74482]:   <os>
Oct 23 23:25:57 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:25:57 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:25:57 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:25:57 user nova-compute[74482]:   </os>
Oct 23 23:25:57 user nova-compute[74482]:   <features>
Oct 23 23:25:57 user nova-compute[74482]:     <acpi/>
Oct 23 23:25:57 user nova-compute[74482]:     <apic/>
Oct 23 23:25:57 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:25:57 user nova-compute[74482]:   </features>
Oct 23 23:25:57 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:25:57 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:25:57 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:25:57 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:25:57 user nova-compute[74482]:   </clock>
Oct 23 23:25:57 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:25:57 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:25:57 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:25:57 user nova-compute[74482]:   </cpu>
Oct 23 23:25:57 user nova-compute[74482]:   <devices>
Oct 23 23:25:57 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:25:57 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:25:57 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk"/>
Oct 23 23:25:57 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:25:57 user nova-compute[74482]:     </disk>
Oct 23 23:25:57 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:25:57 user nova-compute[74482]:       <mac address="fa:16:3e:07:68:67"/>
Oct 23 23:25:57 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:25:57 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:25:57 user nova-compute[74482]:       <target dev="tap893f5969-9b"/>
Oct 23 23:25:57 user nova-compute[74482]:     </interface>
Oct 23 23:25:57 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:25:57 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/console.log" append="off"/>
Oct 23 23:25:57 user nova-compute[74482]:     </serial>
Oct 23 23:25:57 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:25:57 user nova-compute[74482]:     <video>
Oct 23 23:25:57 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:25:57 user nova-compute[74482]:     </video>
Oct 23 23:25:57 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:25:57 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:25:57 user nova-compute[74482]:     </rng>
Oct 23 23:25:57 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:25:57 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:25:57 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:25:57 user nova-compute[74482]:     </memballoon>
Oct 23 23:25:57 user nova-compute[74482]:   </devices>
Oct 23 23:25:57 user nova-compute[74482]: </domain>
Oct 23 23:25:57 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-248313517',display_name='tempest-TestStampPattern-server-248313517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-248313517',id=37,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7YQZm1GfqtZoOS480LjJpdLzFfHr8ohWltRZjWaUsDY7dilvyzekzrkZYBE59rzhwwvndw38f2+LRwrE6/EhfokssEcMuybAOSKBD0XCZ5rgLApMr4Fjos3ZmCSubEKQ==',key_name='tempest-TestStampPattern-726908670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5990acffa754d12b9bb47fc0f44f0e8',ramdisk_id='',reservation_id='r-wmjlr0ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-5890009',owner_user_name='tempest-TestStampPattern-5890009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:25:55Z,user_data=None,user_id='03405619ccc741db816ae85847d709dc',uuid=193ff2db-80a1-406a-95f2-277c798fe86f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converting VIF {"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:68:67,bridge_name='br-int',has_traffic_filtering=True,id=893f5969-9bdd-4417-a50e-425d262ebf33,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893f5969-9b') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG os_vif [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:68:67,bridge_name='br-int',has_traffic_filtering=True,id=893f5969-9bdd-4417-a50e-425d262ebf33,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893f5969-9b') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '940cb72a-6b24-547d-9fb1-97cccaf711d8', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap893f5969-9b, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap893f5969-9b, col_values=(('qos', UUID('19f20b60-c52f-40f8-a7af-39094f058826')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap893f5969-9b, col_values=(('external_ids', {'iface-id': '893f5969-9bdd-4417-a50e-425d262ebf33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:68:67', 'vm-uuid': '193ff2db-80a1-406a-95f2-277c798fe86f'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:57 user nova-compute[74482]: INFO os_vif [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:68:67,bridge_name='br-int',has_traffic_filtering=True,id=893f5969-9bdd-4417-a50e-425d262ebf33,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893f5969-9b')
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No VIF found with MAC fa:16:3e:07:68:67, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-7f903173-d6a3-4e2b-9e72-21e7fc7ec758 req-441e3600-9fb5-42ff-a07f-6ddab0c8e0bd service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updated VIF entry in instance network info cache for port 893f5969-9bdd-4417-a50e-425d262ebf33. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-7f903173-d6a3-4e2b-9e72-21e7fc7ec758 req-441e3600-9fb5-42ff-a07f-6ddab0c8e0bd service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updating instance_info_cache with network_info: [{"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:25:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7f903173-d6a3-4e2b-9e72-21e7fc7ec758 req-441e3600-9fb5-42ff-a07f-6ddab0c8e0bd service nova] Releasing lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:25:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-13e192a2-1f3e-4809-8323-8364c554620b req-486152a6-052c-4c33-9f54-0455dafb64bd service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received event network-vif-plugged-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:25:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-13e192a2-1f3e-4809-8323-8364c554620b req-486152a6-052c-4c33-9f54-0455dafb64bd service nova] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:25:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-13e192a2-1f3e-4809-8323-8364c554620b req-486152a6-052c-4c33-9f54-0455dafb64bd service nova] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:25:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-13e192a2-1f3e-4809-8323-8364c554620b req-486152a6-052c-4c33-9f54-0455dafb64bd service nova] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:25:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-13e192a2-1f3e-4809-8323-8364c554620b req-486152a6-052c-4c33-9f54-0455dafb64bd service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] No waiting events found dispatching network-vif-plugged-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:25:58 user nova-compute[74482]: WARNING nova.compute.manager [req-13e192a2-1f3e-4809-8323-8364c554620b req-486152a6-052c-4c33-9f54-0455dafb64bd service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received unexpected event network-vif-plugged-893f5969-9bdd-4417-a50e-425d262ebf33 for instance with vm_state building and task_state spawning.
Oct 23 23:25:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:25:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:26:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Instance spawned successfully.
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:26:00 user nova-compute[74482]: INFO nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Took 5.58 seconds to spawn the instance on the hypervisor.
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-806097c0-89cf-4388-97bd-411b847dda97 req-c406e9ff-656a-418c-8121-822042921cff service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received event network-vif-plugged-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-806097c0-89cf-4388-97bd-411b847dda97 req-c406e9ff-656a-418c-8121-822042921cff service nova] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-806097c0-89cf-4388-97bd-411b847dda97 req-c406e9ff-656a-418c-8121-822042921cff service nova] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-806097c0-89cf-4388-97bd-411b847dda97 req-c406e9ff-656a-418c-8121-822042921cff service nova] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-806097c0-89cf-4388-97bd-411b847dda97 req-c406e9ff-656a-418c-8121-822042921cff service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] No waiting events found dispatching network-vif-plugged-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:26:00 user nova-compute[74482]: WARNING nova.compute.manager [req-806097c0-89cf-4388-97bd-411b847dda97 req-c406e9ff-656a-418c-8121-822042921cff service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received unexpected event network-vif-plugged-893f5969-9bdd-4417-a50e-425d262ebf33 for instance with vm_state building and task_state spawning.
Oct 23 23:26:00 user nova-compute[74482]: INFO nova.compute.manager [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Took 6.28 seconds to build instance.
Oct 23 23:26:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-629507fb-f60f-41b2-b67c-e744da955f04 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.391s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:26:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:26:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:26:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:26:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:26:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updating instance_info_cache with network_info: [{"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:26:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:26:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:26:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:26:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:26:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:26:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:26:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:26:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:26:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:26:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-f14b428c-f096-4e64-96ae-75d501740c6c req-a62e593e-3f8b-4958-96eb-f41762fc93a2 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received event network-changed-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:26:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-f14b428c-f096-4e64-96ae-75d501740c6c req-a62e593e-3f8b-4958-96eb-f41762fc93a2 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Refreshing instance network info cache due to event network-changed-0c1977fc-d5a6-4955-81c3-fc8125edfa72. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:26:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f14b428c-f096-4e64-96ae-75d501740c6c req-a62e593e-3f8b-4958-96eb-f41762fc93a2 service nova] Acquiring lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:26:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f14b428c-f096-4e64-96ae-75d501740c6c req-a62e593e-3f8b-4958-96eb-f41762fc93a2 service nova] Acquired lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:26:29 user nova-compute[74482]: DEBUG nova.network.neutron [req-f14b428c-f096-4e64-96ae-75d501740c6c req-a62e593e-3f8b-4958-96eb-f41762fc93a2 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Refreshing network info cache for port 0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:26:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:29 user nova-compute[74482]: DEBUG nova.network.neutron [req-f14b428c-f096-4e64-96ae-75d501740c6c req-a62e593e-3f8b-4958-96eb-f41762fc93a2 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Updated VIF entry in instance network info cache for port 0c1977fc-d5a6-4955-81c3-fc8125edfa72. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:26:29 user nova-compute[74482]: DEBUG nova.network.neutron [req-f14b428c-f096-4e64-96ae-75d501740c6c req-a62e593e-3f8b-4958-96eb-f41762fc93a2 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Updating instance_info_cache with network_info: [{"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:26:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f14b428c-f096-4e64-96ae-75d501740c6c req-a62e593e-3f8b-4958-96eb-f41762fc93a2 service nova] Releasing lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:26:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:26:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG nova.objects.instance [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lazy-loading 'flavor' on Instance uuid e95c5295-1725-4b87-8738-52060b895852 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:34 user nova-compute[74482]: INFO nova.compute.manager [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Attaching volume 1d65c404-497c-4c49-9951-016edbdcb80a to /dev/vdb
Oct 23 23:26:34 user nova-compute[74482]: DEBUG os_brick.utils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[262bb78c-10e7-4b48-9ec5-c3a927eecd09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[258dcf5e-f08c-4e93-9979-006e6d21a29d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[72155e5e-460a-4c4d-bb1e-607613adea8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6d56a3-f970-44ba-9b93-7a8889164623]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:26:34 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:26:34 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf8d130-97f3-4110-bb24-91cbfb8e2765]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG os_brick.utils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:26:34 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Updating existing volume attachment record: 86ef0052-5b27-4b0e-9f2b-e49acce31440 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:26:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:26:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:26:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:26:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:39 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:26:39 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=25.083450317382812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0d0a776b-2956-426b-965a-c57559ae00df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e95c5295-1725-4b87-8738-52060b895852 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 193ff2db-80a1-406a-95f2-277c798fe86f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:26:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFEDOgoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:26:51 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:26:51 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:26:51 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35610212-41ab-4ffe-9f30-8ade8bc4fed6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:26:51 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f084ac2-e8b9-4a9e-a68e-44d589d801dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a] added
Oct 23 23:26:51 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60bd94d-4af5-400d-a865-42fe7151586f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a1f26b-5fab-4ebf-9e54-845325f9f155]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFEDOgoe {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFEDOgoe" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[054de983-645d-40e3-a528-e130c781418b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFEDOgoe'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[01346556-0cd6-405d-9f29-9bef388f9aed]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1bc606-30f1-416a-8c34-603cd35b7df6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:26:51 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:26:51 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e400b0-a0b5-4c5c-9bbc-211c7162076e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a, portal: 172.16.0.220,3260]
Oct 23 23:26:51 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a, portal: 172.16.0.220,3260] successful.
Oct 23 23:26:51 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[429174a3-1c5b-406e-87a5-4407268d56e3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebf61fd-b812-4c36-9bc9-ea2933f9c4e0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:26:51 user nova-compute[74482]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a (non-flash)
Oct 23 23:26:51 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:26:51 user nova-compute[74482]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a (non-flash)
Oct 23 23:26:51 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd13990-d333-40b5-904f-c5b83db40e34]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:26:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFEDOgoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:26:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:26:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:26:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26233643130623864', 'path': '/dev/sdc'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:26:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233643130623864', 'path': '/dev/sdc'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:26:52 user nova-compute[74482]: DEBUG nova.objects.instance [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lazy-loading 'flavor' on Instance uuid e95c5295-1725-4b87-8738-52060b895852 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:26:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:26:52 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:26:52 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:26:52 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:26:52 user nova-compute[74482]:   <serial>1d65c404-497c-4c49-9951-016edbdcb80a</serial>
Oct 23 23:26:52 user nova-compute[74482]: </disk>
Oct 23 23:26:52 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:26:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:26:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:26:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] No VIF found with MAC fa:16:3e:5e:63:19, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:26:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-57fc195b-ba49-4419-a20c-8e79b42ef914 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.889s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:54 user nova-compute[74482]: INFO nova.compute.manager [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Detaching volume 1d65c404-497c-4c49-9951-016edbdcb80a
Oct 23 23:26:54 user nova-compute[74482]: INFO nova.virt.block_device [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Attempting to driver detach volume 1d65c404-497c-4c49-9951-016edbdcb80a from mountpoint /dev/vdb
Oct 23 23:26:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Attempting to detach device vdb from instance e95c5295-1725-4b87-8738-52060b895852 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:26:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:26:54 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:26:54 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:26:54 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:26:54 user nova-compute[74482]:   <serial>1d65c404-497c-4c49-9951-016edbdcb80a</serial>
Oct 23 23:26:54 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:26:54 user nova-compute[74482]: </disk>
Oct 23 23:26:54 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:26:54 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Successfully detached device vdb from instance e95c5295-1725-4b87-8738-52060b895852 from the persistent domain config.
Oct 23 23:26:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e95c5295-1725-4b87-8738-52060b895852 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:26:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:26:54 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:26:54 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:26:54 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:26:54 user nova-compute[74482]:   <serial>1d65c404-497c-4c49-9951-016edbdcb80a</serial>
Oct 23 23:26:54 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:26:54 user nova-compute[74482]: </disk>
Oct 23 23:26:54 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e95c5295-1725-4b87-8738-52060b895852 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:55 user nova-compute[74482]: INFO nova.compute.manager [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Terminating instance
Oct 23 23:26:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-a38d6722-f433-4564-a740-ac305e6a247c req-1393d3f9-203e-4711-8fa8-4658e7f5427f service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-unplugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a38d6722-f433-4564-a740-ac305e6a247c req-1393d3f9-203e-4711-8fa8-4658e7f5427f service nova] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a38d6722-f433-4564-a740-ac305e6a247c req-1393d3f9-203e-4711-8fa8-4658e7f5427f service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a38d6722-f433-4564-a740-ac305e6a247c req-1393d3f9-203e-4711-8fa8-4658e7f5427f service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-a38d6722-f433-4564-a740-ac305e6a247c req-1393d3f9-203e-4711-8fa8-4658e7f5427f service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] No waiting events found dispatching network-vif-unplugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG nova.compute.manager [req-a38d6722-f433-4564-a740-ac305e6a247c req-1393d3f9-203e-4711-8fa8-4658e7f5427f service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-unplugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:26:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Instance destroyed successfully.
Oct 23 23:26:56 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lazy-loading 'resources' on Instance uuid 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:22:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-924066307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-229507823',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbCfjYsBkcYTjC7+BvlkhXzn/7Z1vcuaHRl7PKXpwyV0hW5CwN/LsbrsNr0VSCPD6hXKLg03ooJ5WzqujSxNmn8B9jolBMSYogIrdkwx8IIK7QcT7Z5q5+rhClEZV/iZQ==',key_name='tempest-keypair-1256523266',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7465627b153c4c6c833cecbfbe2aad25',ramdisk_id='',reservation_id='r-c01l1bfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1658413054',owner_user_name='tempest-ServerActionsV293TestJSON-1658413054-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='240332b3a8c04317b8fe4a6be2d2b0ca',uuid=7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converting VIF {"id": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "address": "fa:16:3e:c4:68:d9", "network": {"id": "f64b9f3b-e6fd-498b-b386-58796914c80a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1987678420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7465627b153c4c6c833cecbfbe2aad25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86c55d34-fb", "ovs_interfaceid": "86c55d34-fb65-4386-b062-6ce8c8fc92d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_vif [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86c55d34-fb, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b83f791-c5a8-479b-8ac3-ee800140195f) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:26:56 user nova-compute[74482]: INFO os_vif [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=86c55d34-fb65-4386-b062-6ce8c8fc92d4,network=Network(f64b9f3b-e6fd-498b-b386-58796914c80a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86c55d34-fb')
Oct 23 23:26:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EikXHSlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:26:56 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d57f2-013b-4398-85ba-40ca54ead7d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:26:56 user nova-compute[74482]: No targets found.
Oct 23 23:26:56 user nova-compute[74482]: iSNS:
Oct 23 23:26:56 user nova-compute[74482]: No targets found.
Oct 23 23:26:56 user nova-compute[74482]: STATIC:
Oct 23 23:26:56 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2
Oct 23 23:26:56 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:26:56 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:26:56 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a
Oct 23 23:26:56 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:26:56 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:26:56 user nova-compute[74482]: FIRMWARE:
Oct 23 23:26:56 user nova-compute[74482]: No targets found.
Oct 23 23:26:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:26:56 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:26:56 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[532058de-b36c-46cf-bbd7-c4757d0b0467]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b04fd5a-1102-4787-b465-cb1364d18b86]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:26:56 user nova-compute[74482]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a (non-flash)
Oct 23 23:26:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 (non-flash)
Oct 23 23:26:56 user nova-compute[74482]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a (non-flash)
Oct 23 23:26:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f304c6ac160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[397e8bde-04ba-4ea6-99bf-76cca9ab76b9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bad058-b8b6-4ae6-b920-22dde971b361]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c639b-e982-4d24-b3f8-ce3ef530aa7c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a55fd9-02f4-4171-8e2e-116b2a73583a]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fefade-d91d-4bdb-835a-b6f023f129fb]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4463cfaa-612c-4c8e-9554-77519d45daba]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260]
Oct 23 23:26:56 user nova-compute[74482]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2, portal: 172.16.0.220,3260] successful.
Oct 23 23:26:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83c54dd7-59ca-4a48-aa37-88a397d864c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6a1975-4ea7-4d42-8ade-1cddd71892b4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] <== disconnect_volume: return (304ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:26:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Deleting instance files /opt/stack/data/nova/instances/7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7_del
Oct 23 23:26:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Deletion of /opt/stack/data/nova/instances/7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7_del complete
Oct 23 23:26:56 user nova-compute[74482]: INFO nova.compute.manager [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 23 23:26:56 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:26:56 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:26:57 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:26:57 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Took 0.74 seconds to deallocate network for instance.
Oct 23 23:26:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-0e6e8d02-30a4-4b58-b464-4c087e6238b4 req-ebd29f04-59c3-4823-9eb7-a55e2857aa5a service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:26:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0e6e8d02-30a4-4b58-b464-4c087e6238b4 req-ebd29f04-59c3-4823-9eb7-a55e2857aa5a service nova] Acquiring lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0e6e8d02-30a4-4b58-b464-4c087e6238b4 req-ebd29f04-59c3-4823-9eb7-a55e2857aa5a service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0e6e8d02-30a4-4b58-b464-4c087e6238b4 req-ebd29f04-59c3-4823-9eb7-a55e2857aa5a service nova] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-0e6e8d02-30a4-4b58-b464-4c087e6238b4 req-ebd29f04-59c3-4823-9eb7-a55e2857aa5a service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] No waiting events found dispatching network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:26:57 user nova-compute[74482]: WARNING nova.compute.manager [req-0e6e8d02-30a4-4b58-b464-4c087e6238b4 req-ebd29f04-59c3-4823-9eb7-a55e2857aa5a service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received unexpected event network-vif-plugged-86c55d34-fb65-4386-b062-6ce8c8fc92d4 for instance with vm_state active and task_state deleting.
Oct 23 23:26:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-0e6e8d02-30a4-4b58-b464-4c087e6238b4 req-ebd29f04-59c3-4823-9eb7-a55e2857aa5a service nova] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Received event network-vif-deleted-86c55d34-fb65-4386-b062-6ce8c8fc92d4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:26:58 user nova-compute[74482]: INFO nova.compute.manager [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Took 0.87 seconds to detach 1 volumes for instance.
Oct 23 23:26:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] [instance: 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7] Deleting volume: 83c54dd7-59ca-4a48-aa37-88a397d864c2 {{(pid=74482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 23:26:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:26:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:26:58 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:26:58 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:26:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:58 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Deleted allocations for instance 7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7
Oct 23 23:26:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4ad35ff3-9f98-42dd-9ae2-782fc252a768 tempest-ServerActionsV293TestJSON-1658413054 tempest-ServerActionsV293TestJSON-1658413054-project-member] Lock "7d3c0f6f-9ad4-480f-8f5f-67ef632f49d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.245s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:26:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:15 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e95c5295-1725-4b87-8738-52060b895852 is timed out.
Oct 23 23:27:15 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Successfully detached device vdb from instance e95c5295-1725-4b87-8738-52060b895852 from the live domain config.
Oct 23 23:27:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFEDOgoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:27:15 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f22ba5e-4211-4c7f-a901-6f95090058b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:27:15 user nova-compute[74482]: No targets found.
Oct 23 23:27:15 user nova-compute[74482]: iSNS:
Oct 23 23:27:15 user nova-compute[74482]: No targets found.
Oct 23 23:27:15 user nova-compute[74482]: STATIC:
Oct 23 23:27:15 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a
Oct 23 23:27:15 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:27:15 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:27:15 user nova-compute[74482]: FIRMWARE:
Oct 23 23:27:15 user nova-compute[74482]: No targets found.
Oct 23 23:27:15 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:27:15 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:27:15 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5902e08e-6c70-4433-a2cb-5f37a3007ee4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d703fc-f4a7-47a8-be4e-03246b8bc482]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a (non-flash)
Oct 23 23:27:15 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a (non-flash)
Oct 23 23:27:15 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308f9d36d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a'): ({'sdc'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Removing single pathed devices sdc {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c10e230-426b-43f8-a60a-eb2710f77a3d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a41d0-0313-4d48-aa62-6c344b7e04e9]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Flushing IO for device /dev/sdc {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3b2e62-d72b-4144-8281-1ac15d21d7b4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a96c911-451f-4f17-a25f-4dd9b88cecbe]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ec3c14-c647-4279-8acd-eb3dac9e04c7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[656a9d87-5571-4584-ba72-e229d6440640]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a, portal: 172.16.0.220,3260]
Oct 23 23:27:15 user nova-compute[74482]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a, portal: 172.16.0.220,3260] successful.
Oct 23 23:27:15 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d65c404-497c-4c49-9951-016edbdcb80a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4934e1b-f006-42e4-b958-cc75c9343de8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] <== disconnect_volume: return (287ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:27:15 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:27:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:16 user nova-compute[74482]: DEBUG nova.objects.instance [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lazy-loading 'flavor' on Instance uuid e95c5295-1725-4b87-8738-52060b895852 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:27:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-20191016-3b65-42e5-a44f-5927f9f7f4d6 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:27:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e95c5295-1725-4b87-8738-52060b895852] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e95c5295-1725-4b87-8738-52060b895852] Updating instance_info_cache with network_info: [{"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-e95c5295-1725-4b87-8738-52060b895852" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e95c5295-1725-4b87-8738-52060b895852] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:26 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:27:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:32 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:27:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:27:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:27:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:27:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:27:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:27:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:27:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:27:39 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:41 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:27:41 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:27:41 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8587MB free_disk=25.08130645751953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0d0a776b-2956-426b-965a-c57559ae00df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e95c5295-1725-4b87-8738-52060b895852 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 193ff2db-80a1-406a-95f2-277c798fe86f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:27:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-72af6048-6f31-43a1-92da-f0f8370781bc req-1f228b16-726e-4fef-979b-c14fec8a3318 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received event network-changed-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-72af6048-6f31-43a1-92da-f0f8370781bc req-1f228b16-726e-4fef-979b-c14fec8a3318 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Refreshing instance network info cache due to event network-changed-893f5969-9bdd-4417-a50e-425d262ebf33. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-72af6048-6f31-43a1-92da-f0f8370781bc req-1f228b16-726e-4fef-979b-c14fec8a3318 service nova] Acquiring lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-72af6048-6f31-43a1-92da-f0f8370781bc req-1f228b16-726e-4fef-979b-c14fec8a3318 service nova] Acquired lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG nova.network.neutron [req-72af6048-6f31-43a1-92da-f0f8370781bc req-1f228b16-726e-4fef-979b-c14fec8a3318 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Refreshing network info cache for port 893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG nova.network.neutron [req-72af6048-6f31-43a1-92da-f0f8370781bc req-1f228b16-726e-4fef-979b-c14fec8a3318 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updated VIF entry in instance network info cache for port 893f5969-9bdd-4417-a50e-425d262ebf33. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG nova.network.neutron [req-72af6048-6f31-43a1-92da-f0f8370781bc req-1f228b16-726e-4fef-979b-c14fec8a3318 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updating instance_info_cache with network_info: [{"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'flavor' on Instance uuid 193ff2db-80a1-406a-95f2-277c798fe86f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-72af6048-6f31-43a1-92da-f0f8370781bc req-1f228b16-726e-4fef-979b-c14fec8a3318 service nova] Releasing lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:27:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:27:46 user nova-compute[74482]: INFO nova.compute.manager [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Attaching volume 172dec7f-1b48-4577-be5c-640a0c5fc4e6 to /dev/vdb
Oct 23 23:27:47 user nova-compute[74482]: DEBUG os_brick.utils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db2c3a-59bf-4b50-b013-8d5acbe50277]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c520a7c6-77a8-4c0f-a670-11321f7e5d1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bb45b2-a991-4700-8870-d1d672b8c832]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd362680-e252-4d22-a3cc-3dc74a7a61d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:27:47 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:27:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd513b-aa5e-4084-86f6-e01835c6e325]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG os_brick.utils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:27:47 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updating existing volume attachment record: b270df06-e1cc-4636-a737-c6c0a3bd82c3 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:27:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:27:56 user nova-compute[74482]: INFO nova.compute.manager [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Terminating instance
Oct 23 23:27:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e95c5295-1725-4b87-8738-52060b895852] Instance destroyed successfully.
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.objects.instance [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lazy-loading 'resources' on Instance uuid e95c5295-1725-4b87-8738-52060b895852 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1922042369',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1922042369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1922042',id=36,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnMKFT/vfULos5ABgMGASNNtI5+zWHkNPemsnt9Qf/QuB/7Pe1frEXdGCIjnEACFiK3SOadnyo1WCnKH3AxR/NtByD/eXJlJtNr68rGqt91PJweyA6s+a0F4nhqdSTEnQ==',key_name='tempest-keypair-703343363',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:24:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='458da81d7c1042a48fb69438dfcc7578',ramdisk_id='',reservation_id='r-73vgqqyp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1385176975',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:24:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0116074d6f0849a3b5e37f7dd649e1dc',uuid=e95c5295-1725-4b87-8738-52060b895852,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Converting VIF {"id": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "address": "fa:16:3e:5e:63:19", "network": {"id": "3e14a05d-41a7-41ac-8f83-4e3f675222cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-735428954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "458da81d7c1042a48fb69438dfcc7578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c1977fc-d5", "ovs_interfaceid": "0c1977fc-d5a6-4955-81c3-fc8125edfa72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:63:19,bridge_name='br-int',has_traffic_filtering=True,id=0c1977fc-d5a6-4955-81c3-fc8125edfa72,network=Network(3e14a05d-41a7-41ac-8f83-4e3f675222cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c1977fc-d5') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG os_vif [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:63:19,bridge_name='br-int',has_traffic_filtering=True,id=0c1977fc-d5a6-4955-81c3-fc8125edfa72,network=Network(3e14a05d-41a7-41ac-8f83-4e3f675222cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c1977fc-d5') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c1977fc-d5, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc630d4d-4278-4170-9607-3741773c33ee) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:27:57 user nova-compute[74482]: INFO os_vif [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:63:19,bridge_name='br-int',has_traffic_filtering=True,id=0c1977fc-d5a6-4955-81c3-fc8125edfa72,network=Network(3e14a05d-41a7-41ac-8f83-4e3f675222cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c1977fc-d5')
Oct 23 23:27:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Deleting instance files /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852_del
Oct 23 23:27:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Deletion of /opt/stack/data/nova/instances/e95c5295-1725-4b87-8738-52060b895852_del complete
Oct 23 23:27:57 user nova-compute[74482]: INFO nova.compute.manager [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] [instance: e95c5295-1725-4b87-8738-52060b895852] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 23 23:27:57 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: e95c5295-1725-4b87-8738-52060b895852] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: e95c5295-1725-4b87-8738-52060b895852] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-62ab7df8-43a7-4462-9505-446a3dda3686 req-8c673cd5-9df1-47ed-a103-51910f7eba75 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received event network-vif-unplugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-62ab7df8-43a7-4462-9505-446a3dda3686 req-8c673cd5-9df1-47ed-a103-51910f7eba75 service nova] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-62ab7df8-43a7-4462-9505-446a3dda3686 req-8c673cd5-9df1-47ed-a103-51910f7eba75 service nova] Lock "e95c5295-1725-4b87-8738-52060b895852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-62ab7df8-43a7-4462-9505-446a3dda3686 req-8c673cd5-9df1-47ed-a103-51910f7eba75 service nova] Lock "e95c5295-1725-4b87-8738-52060b895852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-62ab7df8-43a7-4462-9505-446a3dda3686 req-8c673cd5-9df1-47ed-a103-51910f7eba75 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] No waiting events found dispatching network-vif-unplugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-62ab7df8-43a7-4462-9505-446a3dda3686 req-8c673cd5-9df1-47ed-a103-51910f7eba75 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received event network-vif-unplugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: e95c5295-1725-4b87-8738-52060b895852] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:27:57 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: e95c5295-1725-4b87-8738-52060b895852] Took 0.71 seconds to deallocate network for instance.
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-4e733d77-7741-438d-9c16-2d24cdc35469 req-e8e419c1-1d4c-4456-a619-3a795d2f5298 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received event network-vif-deleted-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:27:57 user nova-compute[74482]: INFO nova.compute.manager [req-4e733d77-7741-438d-9c16-2d24cdc35469 req-e8e419c1-1d4c-4456-a619-3a795d2f5298 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Neutron deleted interface 0c1977fc-d5a6-4955-81c3-fc8125edfa72; detaching it from the instance and deleting it from the info cache
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-4e733d77-7741-438d-9c16-2d24cdc35469 req-e8e419c1-1d4c-4456-a619-3a795d2f5298 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-4e733d77-7741-438d-9c16-2d24cdc35469 req-e8e419c1-1d4c-4456-a619-3a795d2f5298 service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Detach interface failed, port_id=0c1977fc-d5a6-4955-81c3-fc8125edfa72, reason: Instance e95c5295-1725-4b87-8738-52060b895852 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:27:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:27:58 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:27:58 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:27:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:27:58 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Deleted allocations for instance e95c5295-1725-4b87-8738-52060b895852
Oct 23 23:27:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-948994e1-9558-4a3f-85b0-1569ec7a4805 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975 tempest-TestServerVolumeAttachScenarioOldVersion-1385176975-project-member] Lock "e95c5295-1725-4b87-8738-52060b895852" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.088s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:27:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:27:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-37a6c84b-c20e-4fa6-9eca-76160aad93f2 req-4de9ec59-08f1-4e8e-baa4-7f59bddb49fb service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received event network-vif-plugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:27:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-37a6c84b-c20e-4fa6-9eca-76160aad93f2 req-4de9ec59-08f1-4e8e-baa4-7f59bddb49fb service nova] Acquiring lock "e95c5295-1725-4b87-8738-52060b895852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:27:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-37a6c84b-c20e-4fa6-9eca-76160aad93f2 req-4de9ec59-08f1-4e8e-baa4-7f59bddb49fb service nova] Lock "e95c5295-1725-4b87-8738-52060b895852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:27:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-37a6c84b-c20e-4fa6-9eca-76160aad93f2 req-4de9ec59-08f1-4e8e-baa4-7f59bddb49fb service nova] Lock "e95c5295-1725-4b87-8738-52060b895852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:27:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-37a6c84b-c20e-4fa6-9eca-76160aad93f2 req-4de9ec59-08f1-4e8e-baa4-7f59bddb49fb service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] No waiting events found dispatching network-vif-plugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:27:59 user nova-compute[74482]: WARNING nova.compute.manager [req-37a6c84b-c20e-4fa6-9eca-76160aad93f2 req-4de9ec59-08f1-4e8e-baa4-7f59bddb49fb service nova] [instance: e95c5295-1725-4b87-8738-52060b895852] Received unexpected event network-vif-plugged-0c1977fc-d5a6-4955-81c3-fc8125edfa72 for instance with vm_state deleted and task_state None.
Oct 23 23:28:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:28:00 user nova-compute[74482]: INFO nova.compute.claims [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Claim successful on node user
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:28:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.policy [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e723ee9b17d24a31b9d63246e0a6b054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f035fff650c45109cdf0779013139ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:28:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Creating image(s)
Oct 23 23:28:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "/opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "/opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "/opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.224s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk 1073741824" returned: 0 in 0.058s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Successfully created port: 3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Cannot resize image /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Ensure instance console log exists: /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Successfully updated port: 3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquired lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-ebea5578-8c9d-46c5-b002-c55b92268f26 req-f9d3a107-869a-42c8-9ebe-28c4394e44d0 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received event network-changed-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-ebea5578-8c9d-46c5-b002-c55b92268f26 req-f9d3a107-869a-42c8-9ebe-28c4394e44d0 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Refreshing instance network info cache due to event network-changed-3e650827-f225-43df-85f3-caf2893e4e30. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:28:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ebea5578-8c9d-46c5-b002-c55b92268f26 req-f9d3a107-869a-42c8-9ebe-28c4394e44d0 service nova] Acquiring lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updating instance_info_cache with network_info: [{"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Releasing lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Instance network_info: |[{"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ebea5578-8c9d-46c5-b002-c55b92268f26 req-f9d3a107-869a-42c8-9ebe-28c4394e44d0 service nova] Acquired lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-ebea5578-8c9d-46c5-b002-c55b92268f26 req-f9d3a107-869a-42c8-9ebe-28c4394e44d0 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Refreshing network info cache for port 3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Start _get_guest_xml network_info=[{"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:28:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:28:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1804628039',display_name='tempest-AttachVolumeNegativeTest-server-1804628039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1804628039',id=38,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrmi45WlhU5yVEWLblSJGEvHGJ9C5rrftXBuuzpG8zQpggkrjSR2vpHSdiZEWOvPiqcddUmA5xoNKlqaaj6Im12S0TcwFmLHN73QbjZJzM3/IlyKb4bFWbtygEZEYaBkw==',key_name='tempest-keypair-778122097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-txbmeber',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:28:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=782d6230-1ba7-4b56-a77e-924ccdfd85d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ae:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e650827-f225-43df-85f3-caf2893e4e30,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e650827-f2') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.objects.instance [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'pci_devices' on Instance uuid 782d6230-1ba7-4b56-a77e-924ccdfd85d4 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:28:02 user nova-compute[74482]:   <uuid>782d6230-1ba7-4b56-a77e-924ccdfd85d4</uuid>
Oct 23 23:28:02 user nova-compute[74482]:   <name>instance-00000026</name>
Oct 23 23:28:02 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:28:02 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:28:02 user nova-compute[74482]:   <metadata>
Oct 23 23:28:02 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:28:02 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:28:02 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1804628039</nova:name>
Oct 23 23:28:02 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:28:02</nova:creationTime>
Oct 23 23:28:02 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:28:02 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:28:02 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:28:02 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:28:02 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:28:02 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:28:02 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:28:02 user nova-compute[74482]:       <nova:owner>
Oct 23 23:28:02 user nova-compute[74482]:         <nova:user uuid="e723ee9b17d24a31b9d63246e0a6b054">tempest-AttachVolumeNegativeTest-873141491-project-member</nova:user>
Oct 23 23:28:02 user nova-compute[74482]:         <nova:project uuid="4f035fff650c45109cdf0779013139ff">tempest-AttachVolumeNegativeTest-873141491</nova:project>
Oct 23 23:28:02 user nova-compute[74482]:       </nova:owner>
Oct 23 23:28:02 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:28:02 user nova-compute[74482]:       <nova:ports>
Oct 23 23:28:02 user nova-compute[74482]:         <nova:port uuid="3e650827-f225-43df-85f3-caf2893e4e30">
Oct 23 23:28:02 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 23:28:02 user nova-compute[74482]:         </nova:port>
Oct 23 23:28:02 user nova-compute[74482]:       </nova:ports>
Oct 23 23:28:02 user nova-compute[74482]:     </nova:instance>
Oct 23 23:28:02 user nova-compute[74482]:   </metadata>
Oct 23 23:28:02 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:28:02 user nova-compute[74482]:     <system>
Oct 23 23:28:02 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:28:02 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:28:02 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:28:02 user nova-compute[74482]:       <entry name="serial">782d6230-1ba7-4b56-a77e-924ccdfd85d4</entry>
Oct 23 23:28:02 user nova-compute[74482]:       <entry name="uuid">782d6230-1ba7-4b56-a77e-924ccdfd85d4</entry>
Oct 23 23:28:02 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:28:02 user nova-compute[74482]:     </system>
Oct 23 23:28:02 user nova-compute[74482]:   </sysinfo>
Oct 23 23:28:02 user nova-compute[74482]:   <os>
Oct 23 23:28:02 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:28:02 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:28:02 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:28:02 user nova-compute[74482]:   </os>
Oct 23 23:28:02 user nova-compute[74482]:   <features>
Oct 23 23:28:02 user nova-compute[74482]:     <acpi/>
Oct 23 23:28:02 user nova-compute[74482]:     <apic/>
Oct 23 23:28:02 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:28:02 user nova-compute[74482]:   </features>
Oct 23 23:28:02 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:28:02 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:28:02 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:28:02 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:28:02 user nova-compute[74482]:   </clock>
Oct 23 23:28:02 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:28:02 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:28:02 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:28:02 user nova-compute[74482]:   </cpu>
Oct 23 23:28:02 user nova-compute[74482]:   <devices>
Oct 23 23:28:02 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:28:02 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:28:02 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk"/>
Oct 23 23:28:02 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:28:02 user nova-compute[74482]:     </disk>
Oct 23 23:28:02 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:28:02 user nova-compute[74482]:       <mac address="fa:16:3e:d7:ae:8b"/>
Oct 23 23:28:02 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:28:02 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:28:02 user nova-compute[74482]:       <target dev="tap3e650827-f2"/>
Oct 23 23:28:02 user nova-compute[74482]:     </interface>
Oct 23 23:28:02 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:28:02 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/console.log" append="off"/>
Oct 23 23:28:02 user nova-compute[74482]:     </serial>
Oct 23 23:28:02 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:28:02 user nova-compute[74482]:     <video>
Oct 23 23:28:02 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:28:02 user nova-compute[74482]:     </video>
Oct 23 23:28:02 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:28:02 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:28:02 user nova-compute[74482]:     </rng>
Oct 23 23:28:02 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:28:02 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:28:02 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:28:02 user nova-compute[74482]:     </memballoon>
Oct 23 23:28:02 user nova-compute[74482]:   </devices>
Oct 23 23:28:02 user nova-compute[74482]: </domain>
Oct 23 23:28:02 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1804628039',display_name='tempest-AttachVolumeNegativeTest-server-1804628039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1804628039',id=38,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrmi45WlhU5yVEWLblSJGEvHGJ9C5rrftXBuuzpG8zQpggkrjSR2vpHSdiZEWOvPiqcddUmA5xoNKlqaaj6Im12S0TcwFmLHN73QbjZJzM3/IlyKb4bFWbtygEZEYaBkw==',key_name='tempest-keypair-778122097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-txbmeber',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:28:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=782d6230-1ba7-4b56-a77e-924ccdfd85d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ae:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e650827-f225-43df-85f3-caf2893e4e30,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e650827-f2') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG os_vif [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ae:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e650827-f225-43df-85f3-caf2893e4e30,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e650827-f2') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09726a7d-2b1a-52df-9dd5-9c972558894f', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e650827-f2, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e650827-f2, col_values=(('qos', UUID('05f93fcb-8770-492f-aab7-61d965b6f0b0')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e650827-f2, col_values=(('external_ids', {'iface-id': '3e650827-f225-43df-85f3-caf2893e4e30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:ae:8b', 'vm-uuid': '782d6230-1ba7-4b56-a77e-924ccdfd85d4'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:02 user nova-compute[74482]: INFO os_vif [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ae:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e650827-f225-43df-85f3-caf2893e4e30,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e650827-f2')
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No VIF found with MAC fa:16:3e:d7:ae:8b, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-ebea5578-8c9d-46c5-b002-c55b92268f26 req-f9d3a107-869a-42c8-9ebe-28c4394e44d0 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updated VIF entry in instance network info cache for port 3e650827-f225-43df-85f3-caf2893e4e30. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG nova.network.neutron [req-ebea5578-8c9d-46c5-b002-c55b92268f26 req-f9d3a107-869a-42c8-9ebe-28c4394e44d0 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updating instance_info_cache with network_info: [{"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:28:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ebea5578-8c9d-46c5-b002-c55b92268f26 req-f9d3a107-869a-42c8-9ebe-28c4394e44d0 service nova] Releasing lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:28:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-58aebcd7-8cb8-4578-b511-f6ba6370e7b7 req-c0681fee-9f42-4691-ba73-479d9bb021a0 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received event network-vif-plugged-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:28:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-58aebcd7-8cb8-4578-b511-f6ba6370e7b7 req-c0681fee-9f42-4691-ba73-479d9bb021a0 service nova] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-58aebcd7-8cb8-4578-b511-f6ba6370e7b7 req-c0681fee-9f42-4691-ba73-479d9bb021a0 service nova] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-58aebcd7-8cb8-4578-b511-f6ba6370e7b7 req-c0681fee-9f42-4691-ba73-479d9bb021a0 service nova] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-58aebcd7-8cb8-4578-b511-f6ba6370e7b7 req-c0681fee-9f42-4691-ba73-479d9bb021a0 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] No waiting events found dispatching network-vif-plugged-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:28:03 user nova-compute[74482]: WARNING nova.compute.manager [req-58aebcd7-8cb8-4578-b511-f6ba6370e7b7 req-c0681fee-9f42-4691-ba73-479d9bb021a0 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received unexpected event network-vif-plugged-3e650827-f225-43df-85f3-caf2893e4e30 for instance with vm_state building and task_state spawning.
Oct 23 23:28:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNJyCGEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:28:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:28:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:28:04 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c87178d-fb3e-45a1-8662-6ceb4244619b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:28:04 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff6aebd-3d26-4d1d-b828-f8021debd862]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6] added
Oct 23 23:28:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b786e9-b5c8-488b-8ec3-17bbb9636f50]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d322e7-e5f4-413f-90c1-6aefcdb9e921]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNJyCGEO {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNJyCGEO" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[193b095a-c1dc-4d1d-bb01-894d604cfde7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VNJyCGEO'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6833c1fc-ac6c-4a4c-afe8-d0f924291beb]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2602ef-0d7f-4ea2-b130-f138a3b82cc3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:28:04 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:28:04 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:28:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:28:04 user nova-compute[74482]: 
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d360c34-7367-4cd8-9d3b-44e878b337f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6, portal: 172.16.0.220,3260]
Oct 23 23:28:04 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6, portal: 172.16.0.220,3260] successful.
Oct 23 23:28:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ed2df-57cb-4569-8886-a0f5d7426b80]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b17167-15a4-4ef7-8dab-e2b4e37c055d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 (non-flash)
Oct 23 23:28:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 (non-flash)
Oct 23 23:28:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2950026-c385-4f4e-bd05-8051acf98215]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNJyCGEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '23337353463323130', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337353463323130', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'flavor' on Instance uuid 193ff2db-80a1-406a-95f2-277c798fe86f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:28:05 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:28:05 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:28:05 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:28:05 user nova-compute[74482]:   <serial>172dec7f-1b48-4577-be5c-640a0c5fc4e6</serial>
Oct 23 23:28:05 user nova-compute[74482]: </disk>
Oct 23 23:28:05 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-702cdaba-441f-4379-b683-e379bf4bc319 req-f5ab5784-a717-47d4-8054-c83fc1341117 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received event network-vif-plugged-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-702cdaba-441f-4379-b683-e379bf4bc319 req-f5ab5784-a717-47d4-8054-c83fc1341117 service nova] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-702cdaba-441f-4379-b683-e379bf4bc319 req-f5ab5784-a717-47d4-8054-c83fc1341117 service nova] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-702cdaba-441f-4379-b683-e379bf4bc319 req-f5ab5784-a717-47d4-8054-c83fc1341117 service nova] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-702cdaba-441f-4379-b683-e379bf4bc319 req-f5ab5784-a717-47d4-8054-c83fc1341117 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] No waiting events found dispatching network-vif-plugged-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:28:05 user nova-compute[74482]: WARNING nova.compute.manager [req-702cdaba-441f-4379-b683-e379bf4bc319 req-f5ab5784-a717-47d4-8054-c83fc1341117 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received unexpected event network-vif-plugged-3e650827-f225-43df-85f3-caf2893e4e30 for instance with vm_state building and task_state spawning.
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:28:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Instance spawned successfully.
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:28:06 user nova-compute[74482]: INFO nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Took 5.37 seconds to spawn the instance on the hypervisor.
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:28:06 user nova-compute[74482]: INFO nova.compute.manager [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Took 5.95 seconds to build instance.
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No VIF found with MAC fa:16:3e:07:68:67, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c31c8c1-cc84-49d4-a33d-17028ce26043 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.075s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1059dc08-43b5-4654-a347-67ee937932da tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.660s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:09 user nova-compute[74482]: INFO nova.compute.manager [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Detaching volume 172dec7f-1b48-4577-be5c-640a0c5fc4e6
Oct 23 23:28:09 user nova-compute[74482]: INFO nova.virt.block_device [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Attempting to driver detach volume 172dec7f-1b48-4577-be5c-640a0c5fc4e6 from mountpoint /dev/vdb
Oct 23 23:28:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Attempting to detach device vdb from instance 193ff2db-80a1-406a-95f2-277c798fe86f from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:28:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:28:09 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:28:09 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:28:09 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:28:09 user nova-compute[74482]:   <serial>172dec7f-1b48-4577-be5c-640a0c5fc4e6</serial>
Oct 23 23:28:09 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:28:09 user nova-compute[74482]: </disk>
Oct 23 23:28:09 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:28:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Successfully detached device vdb from instance 193ff2db-80a1-406a-95f2-277c798fe86f from the persistent domain config.
Oct 23 23:28:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 193ff2db-80a1-406a-95f2-277c798fe86f from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:28:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:28:09 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:28:09 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:28:09 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:28:09 user nova-compute[74482]:   <serial>172dec7f-1b48-4577-be5c-640a0c5fc4e6</serial>
Oct 23 23:28:09 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:28:09 user nova-compute[74482]: </disk>
Oct 23 23:28:09 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:28:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 193ff2db-80a1-406a-95f2-277c798fe86f {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:28:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:28:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:28:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:28:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:28:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:28:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:28:27 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:28:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 0d0a776b-2956-426b-965a-c57559ae00df {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:28:28 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updating instance_info_cache with network_info: [{"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:28:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-0d0a776b-2956-426b-965a-c57559ae00df" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:28:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:28:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:28:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:28:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:28:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:28:29 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 193ff2db-80a1-406a-95f2-277c798fe86f is timed out.
Oct 23 23:28:29 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Successfully detached device vdb from instance 193ff2db-80a1-406a-95f2-277c798fe86f from the live domain config.
Oct 23 23:28:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:28:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNJyCGEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:28:29 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:28:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:28:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:28:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbca1582-1f8a-46b6-82ca-029d1af48496]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:28:30 user nova-compute[74482]: No targets found.
Oct 23 23:28:30 user nova-compute[74482]: iSNS:
Oct 23 23:28:30 user nova-compute[74482]: No targets found.
Oct 23 23:28:30 user nova-compute[74482]: STATIC:
Oct 23 23:28:30 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6
Oct 23 23:28:30 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:28:30 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:28:30 user nova-compute[74482]: FIRMWARE:
Oct 23 23:28:30 user nova-compute[74482]: No targets found.
Oct 23 23:28:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:28:30 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:28:30 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4b43c-2c26-42e6-bcd3-ab7ac1c6fef7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd13093-b354-47b0-a7ba-8401f36846e6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 (non-flash)
Oct 23 23:28:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 (non-flash)
Oct 23 23:28:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30842645e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2bbeaa-38d6-4f98-8327-f04ae34ff961]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce9428e-85be-41ab-b225-3c25f99f56b4]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef07076-bd5e-4ded-bc67-790cbd0b2d2e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c57fd38-71db-4f62-8fe7-85fdfc3f385c]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ed6c5-8ea5-4aaa-b345-d2bc71bb1c43]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[062a141f-b1e1-41bf-953f-5134f9695034]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6, portal: 172.16.0.220,3260]
Oct 23 23:28:30 user nova-compute[74482]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6, portal: 172.16.0.220,3260] successful.
Oct 23 23:28:30 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:172dec7f-1b48-4577-be5c-640a0c5fc4e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65cc6a7-8693-4989-bdae-9895c5b4774f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] <== disconnect_volume: return (341ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:28:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:28:31 user nova-compute[74482]: DEBUG nova.objects.instance [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'flavor' on Instance uuid 193ff2db-80a1-406a-95f2-277c798fe86f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:28:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-146eb2c3-0f34-4389-b9ac-3ac7fad8ffe3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.861s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:28:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:28:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:41 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:28:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:28:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:28:43 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:28:43 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:28:43 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=25.06958770751953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 0d0a776b-2956-426b-965a-c57559ae00df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 193ff2db-80a1-406a-95f2-277c798fe86f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:28:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:28:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:28:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "0d0a776b-2956-426b-965a-c57559ae00df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0d0a776b-2956-426b-965a-c57559ae00df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "0d0a776b-2956-426b-965a-c57559ae00df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:04 user nova-compute[74482]: INFO nova.compute.manager [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Terminating instance
Oct 23 23:29:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-5430104e-b2d7-44c9-aefb-3df152f90639 req-dc873c52-dede-4fb1-aca8-36ba7b5d24e9 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received event network-vif-unplugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5430104e-b2d7-44c9-aefb-3df152f90639 req-dc873c52-dede-4fb1-aca8-36ba7b5d24e9 service nova] Acquiring lock "0d0a776b-2956-426b-965a-c57559ae00df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5430104e-b2d7-44c9-aefb-3df152f90639 req-dc873c52-dede-4fb1-aca8-36ba7b5d24e9 service nova] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5430104e-b2d7-44c9-aefb-3df152f90639 req-dc873c52-dede-4fb1-aca8-36ba7b5d24e9 service nova] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-5430104e-b2d7-44c9-aefb-3df152f90639 req-dc873c52-dede-4fb1-aca8-36ba7b5d24e9 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] No waiting events found dispatching network-vif-unplugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-5430104e-b2d7-44c9-aefb-3df152f90639 req-dc873c52-dede-4fb1-aca8-36ba7b5d24e9 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received event network-vif-unplugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:29:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Instance destroyed successfully.
Oct 23 23:29:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lazy-loading 'resources' on Instance uuid 0d0a776b-2956-426b-965a-c57559ae00df {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1191446515',display_name='tempest-ServersNegativeTestJSON-server-1191446515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1191446515',id=32,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:19:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b34c7b717135415dafd38e0e2eb33e60',ramdisk_id='',reservation_id='r-iwv40pex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-683427977',owner_user_name='tempest-ServersNegativeTestJSON-683427977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:19:58Z,user_data=None,user_id='8af1815fe2604193909609dedcd1925a',uuid=0d0a776b-2956-426b-965a-c57559ae00df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converting VIF {"id": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "address": "fa:16:3e:91:04:a4", "network": {"id": "c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709993374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b34c7b717135415dafd38e0e2eb33e60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap432505aa-b2", "ovs_interfaceid": "432505aa-b2d9-4cfe-b6c0-d2b93cb92675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:04:a4,bridge_name='br-int',has_traffic_filtering=True,id=432505aa-b2d9-4cfe-b6c0-d2b93cb92675,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap432505aa-b2') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG os_vif [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:04:a4,bridge_name='br-int',has_traffic_filtering=True,id=432505aa-b2d9-4cfe-b6c0-d2b93cb92675,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap432505aa-b2') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap432505aa-b2, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=677b636f-ce44-45c4-9699-ec681af3cb86) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:29:05 user nova-compute[74482]: INFO os_vif [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:04:a4,bridge_name='br-int',has_traffic_filtering=True,id=432505aa-b2d9-4cfe-b6c0-d2b93cb92675,network=Network(c12aa84c-86ce-4c2e-a7bb-8c73c1a837ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap432505aa-b2')
Oct 23 23:29:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Deleting instance files /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df_del
Oct 23 23:29:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Deletion of /opt/stack/data/nova/instances/0d0a776b-2956-426b-965a-c57559ae00df_del complete
Oct 23 23:29:05 user nova-compute[74482]: INFO nova.compute.manager [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Took 0.66 seconds to destroy the instance on the hypervisor.
Oct 23 23:29:05 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:29:05 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:29:06 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:29:06 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Took 0.65 seconds to deallocate network for instance.
Oct 23 23:29:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-9fe45e7c-70db-4f77-8f5f-bfefcdcc58c2 req-c6aa0055-54f5-405a-8407-5096cd4bdab4 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received event network-vif-deleted-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:29:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:06 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:29:06 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:29:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:06 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Deleted allocations for instance 0d0a776b-2956-426b-965a-c57559ae00df
Oct 23 23:29:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f2a6ccea-9b03-43f9-ad9e-b38ae9ef14d2 tempest-ServersNegativeTestJSON-683427977 tempest-ServersNegativeTestJSON-683427977-project-member] Lock "0d0a776b-2956-426b-965a-c57559ae00df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.687s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-c27abdba-997f-4999-8022-9f218fcf3433 req-528ca1aa-7217-4375-9736-d4d84eac4553 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received event network-vif-plugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:29:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c27abdba-997f-4999-8022-9f218fcf3433 req-528ca1aa-7217-4375-9736-d4d84eac4553 service nova] Acquiring lock "0d0a776b-2956-426b-965a-c57559ae00df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c27abdba-997f-4999-8022-9f218fcf3433 req-528ca1aa-7217-4375-9736-d4d84eac4553 service nova] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c27abdba-997f-4999-8022-9f218fcf3433 req-528ca1aa-7217-4375-9736-d4d84eac4553 service nova] Lock "0d0a776b-2956-426b-965a-c57559ae00df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-c27abdba-997f-4999-8022-9f218fcf3433 req-528ca1aa-7217-4375-9736-d4d84eac4553 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] No waiting events found dispatching network-vif-plugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:29:07 user nova-compute[74482]: WARNING nova.compute.manager [req-c27abdba-997f-4999-8022-9f218fcf3433 req-528ca1aa-7217-4375-9736-d4d84eac4553 service nova] [instance: 0d0a776b-2956-426b-965a-c57559ae00df] Received unexpected event network-vif-plugged-432505aa-b2d9-4cfe-b6c0-d2b93cb92675 for instance with vm_state deleted and task_state None.
Oct 23 23:29:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:29:10 user nova-compute[74482]: INFO nova.compute.manager [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] instance snapshotting
Oct 23 23:29:10 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Beginning live snapshot process
Oct 23 23:29:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json -f qcow2 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json -f qcow2 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json -f qcow2" returned: 0 in 0.274s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2p91c_ug/e16b654915044757854436b9da1dfa31.delta 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2p91c_ug/e16b654915044757854436b9da1dfa31.delta 1073741824" returned: 0 in 0.048s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:11 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 23:29:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:29:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 23:29:12 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 23:29:12 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:29:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2p91c_ug/e16b654915044757854436b9da1dfa31.delta /opt/stack/data/nova/instances/snapshots/tmp2p91c_ug/e16b654915044757854436b9da1dfa31 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2p91c_ug/e16b654915044757854436b9da1dfa31.delta /opt/stack/data/nova/instances/snapshots/tmp2p91c_ug/e16b654915044757854436b9da1dfa31" returned: 0 in 0.407s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:12 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Snapshot extracted, beginning image upload
Oct 23 23:29:15 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Snapshot image upload complete
Oct 23 23:29:15 user nova-compute[74482]: INFO nova.compute.manager [None req-a444db0f-dd25-4413-aac0-8a8c21a7a7f2 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Took 5.14 seconds to snapshot the instance on the hypervisor.
Oct 23 23:29:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:29:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:29:17 user nova-compute[74482]: INFO nova.compute.claims [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Claim successful on node user
Oct 23 23:29:17 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:29:18 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:29:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG nova.policy [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03405619ccc741db816ae85847d709dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5990acffa754d12b9bb47fc0f44f0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:29:18 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Creating image(s)
Oct 23 23:29:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "/opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "/opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.154s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Successfully created port: 8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:29:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:19 user nova-compute[74482]: DEBUG nova.virt.images [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] b273a9f8-5b9d-4b0b-8ea7-883509cfa094 was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 23:29:19 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:29:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa.part /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa.part /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa.converted" returned: 0 in 0.484s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.860s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Successfully updated port: 8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-b961dbdd-8b66-4a82-85b9-aebaaaf5b47f req-ffd9f5f5-efbc-4435-9d9b-030992cd1c0d service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received event network-changed-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-b961dbdd-8b66-4a82-85b9-aebaaaf5b47f req-ffd9f5f5-efbc-4435-9d9b-030992cd1c0d service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Refreshing instance network info cache due to event network-changed-8c8022d9-b70f-4b18-9d63-515613278b2a. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b961dbdd-8b66-4a82-85b9-aebaaaf5b47f req-ffd9f5f5-efbc-4435-9d9b-030992cd1c0d service nova] Acquiring lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b961dbdd-8b66-4a82-85b9-aebaaaf5b47f req-ffd9f5f5-efbc-4435-9d9b-030992cd1c0d service nova] Acquired lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-b961dbdd-8b66-4a82-85b9-aebaaaf5b47f req-ffd9f5f5-efbc-4435-9d9b-030992cd1c0d service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Refreshing network info cache for port 8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-b961dbdd-8b66-4a82-85b9-aebaaaf5b47f req-ffd9f5f5-efbc-4435-9d9b-030992cd1c0d service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa,backing_fmt=raw /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa,backing_fmt=raw /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk 1073741824" returned: 0 in 0.048s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-b961dbdd-8b66-4a82-85b9-aebaaaf5b47f req-ffd9f5f5-efbc-4435-9d9b-030992cd1c0d service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b961dbdd-8b66-4a82-85b9-aebaaaf5b47f req-ffd9f5f5-efbc-4435-9d9b-030992cd1c0d service nova] Releasing lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquired lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Ensure instance console log exists: /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Updating instance_info_cache with network_info: [{"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Releasing lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Instance network_info: |[{"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Start _get_guest_xml network_info=[{"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='cdb99a947f7c805cd7526301a02869da',container_format='bare',created_at=2023-10-23T23:29:10Z,direct_url=<?>,disk_format='qcow2',id=b273a9f8-5b9d-4b0b-8ea7-883509cfa094,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2075082842',owner='f5990acffa754d12b9bb47fc0f44f0e8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T23:29:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': 'b273a9f8-5b9d-4b0b-8ea7-883509cfa094'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:29:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:29:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cdb99a947f7c805cd7526301a02869da',container_format='bare',created_at=2023-10-23T23:29:10Z,direct_url=<?>,disk_format='qcow2',id=b273a9f8-5b9d-4b0b-8ea7-883509cfa094,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2075082842',owner='f5990acffa754d12b9bb47fc0f44f0e8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T23:29:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-32898761',display_name='tempest-TestStampPattern-server-32898761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-32898761',id=39,image_ref='b273a9f8-5b9d-4b0b-8ea7-883509cfa094',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7YQZm1GfqtZoOS480LjJpdLzFfHr8ohWltRZjWaUsDY7dilvyzekzrkZYBE59rzhwwvndw38f2+LRwrE6/EhfokssEcMuybAOSKBD0XCZ5rgLApMr4Fjos3ZmCSubEKQ==',key_name='tempest-TestStampPattern-726908670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5990acffa754d12b9bb47fc0f44f0e8',ramdisk_id='',reservation_id='r-1e61p064',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='193ff2db-80a1-406a-95f2-277c798fe86f',image_min_disk='1',image_min_ram='0',image_owner_id='f5990acffa754d12b9bb47fc0f44f0e8',image_owner_project_name='tempest-TestStampPattern-5890009',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-5890009-project-member',image_user_id='03405619ccc741db816ae85847d709dc',network_allocated='True',owner_project_name='tempest-TestStampPattern-5890009',owner_user_name='tempest-TestStampPattern-5890009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:29:18Z,user_data=None,user_id='03405619ccc741db816ae85847d709dc',uuid=bdd23906-9be5-4f01-822c-35f87edadcfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converting VIF {"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6d:28,bridge_name='br-int',has_traffic_filtering=True,id=8c8022d9-b70f-4b18-9d63-515613278b2a,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8022d9-b7') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'pci_devices' on Instance uuid bdd23906-9be5-4f01-822c-35f87edadcfd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:29:21 user nova-compute[74482]:   <uuid>bdd23906-9be5-4f01-822c-35f87edadcfd</uuid>
Oct 23 23:29:21 user nova-compute[74482]:   <name>instance-00000027</name>
Oct 23 23:29:21 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:29:21 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:29:21 user nova-compute[74482]:   <metadata>
Oct 23 23:29:21 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:29:21 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:29:21 user nova-compute[74482]:       <nova:name>tempest-TestStampPattern-server-32898761</nova:name>
Oct 23 23:29:21 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:29:21</nova:creationTime>
Oct 23 23:29:21 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:29:21 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:29:21 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:29:21 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:29:21 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:29:21 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:29:21 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:29:21 user nova-compute[74482]:       <nova:owner>
Oct 23 23:29:21 user nova-compute[74482]:         <nova:user uuid="03405619ccc741db816ae85847d709dc">tempest-TestStampPattern-5890009-project-member</nova:user>
Oct 23 23:29:21 user nova-compute[74482]:         <nova:project uuid="f5990acffa754d12b9bb47fc0f44f0e8">tempest-TestStampPattern-5890009</nova:project>
Oct 23 23:29:21 user nova-compute[74482]:       </nova:owner>
Oct 23 23:29:21 user nova-compute[74482]:       <nova:root type="image" uuid="b273a9f8-5b9d-4b0b-8ea7-883509cfa094"/>
Oct 23 23:29:21 user nova-compute[74482]:       <nova:ports>
Oct 23 23:29:21 user nova-compute[74482]:         <nova:port uuid="8c8022d9-b70f-4b18-9d63-515613278b2a">
Oct 23 23:29:21 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 23:29:21 user nova-compute[74482]:         </nova:port>
Oct 23 23:29:21 user nova-compute[74482]:       </nova:ports>
Oct 23 23:29:21 user nova-compute[74482]:     </nova:instance>
Oct 23 23:29:21 user nova-compute[74482]:   </metadata>
Oct 23 23:29:21 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:29:21 user nova-compute[74482]:     <system>
Oct 23 23:29:21 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:29:21 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:29:21 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:29:21 user nova-compute[74482]:       <entry name="serial">bdd23906-9be5-4f01-822c-35f87edadcfd</entry>
Oct 23 23:29:21 user nova-compute[74482]:       <entry name="uuid">bdd23906-9be5-4f01-822c-35f87edadcfd</entry>
Oct 23 23:29:21 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:29:21 user nova-compute[74482]:     </system>
Oct 23 23:29:21 user nova-compute[74482]:   </sysinfo>
Oct 23 23:29:21 user nova-compute[74482]:   <os>
Oct 23 23:29:21 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:29:21 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:29:21 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:29:21 user nova-compute[74482]:   </os>
Oct 23 23:29:21 user nova-compute[74482]:   <features>
Oct 23 23:29:21 user nova-compute[74482]:     <acpi/>
Oct 23 23:29:21 user nova-compute[74482]:     <apic/>
Oct 23 23:29:21 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:29:21 user nova-compute[74482]:   </features>
Oct 23 23:29:21 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:29:21 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:29:21 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:29:21 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:29:21 user nova-compute[74482]:   </clock>
Oct 23 23:29:21 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:29:21 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:29:21 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:29:21 user nova-compute[74482]:   </cpu>
Oct 23 23:29:21 user nova-compute[74482]:   <devices>
Oct 23 23:29:21 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:29:21 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:29:21 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk"/>
Oct 23 23:29:21 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:29:21 user nova-compute[74482]:     </disk>
Oct 23 23:29:21 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:29:21 user nova-compute[74482]:       <mac address="fa:16:3e:61:6d:28"/>
Oct 23 23:29:21 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:29:21 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:29:21 user nova-compute[74482]:       <target dev="tap8c8022d9-b7"/>
Oct 23 23:29:21 user nova-compute[74482]:     </interface>
Oct 23 23:29:21 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:29:21 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/console.log" append="off"/>
Oct 23 23:29:21 user nova-compute[74482]:     </serial>
Oct 23 23:29:21 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:29:21 user nova-compute[74482]:     <video>
Oct 23 23:29:21 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:29:21 user nova-compute[74482]:     </video>
Oct 23 23:29:21 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:29:21 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:29:21 user nova-compute[74482]:     </rng>
Oct 23 23:29:21 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:29:21 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:29:21 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:29:21 user nova-compute[74482]:     </memballoon>
Oct 23 23:29:21 user nova-compute[74482]:   </devices>
Oct 23 23:29:21 user nova-compute[74482]: </domain>
Oct 23 23:29:21 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-32898761',display_name='tempest-TestStampPattern-server-32898761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-32898761',id=39,image_ref='b273a9f8-5b9d-4b0b-8ea7-883509cfa094',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7YQZm1GfqtZoOS480LjJpdLzFfHr8ohWltRZjWaUsDY7dilvyzekzrkZYBE59rzhwwvndw38f2+LRwrE6/EhfokssEcMuybAOSKBD0XCZ5rgLApMr4Fjos3ZmCSubEKQ==',key_name='tempest-TestStampPattern-726908670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5990acffa754d12b9bb47fc0f44f0e8',ramdisk_id='',reservation_id='r-1e61p064',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='193ff2db-80a1-406a-95f2-277c798fe86f',image_min_disk='1',image_min_ram='0',image_owner_id='f5990acffa754d12b9bb47fc0f44f0e8',image_owner_project_name='tempest-TestStampPattern-5890009',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-5890009-project-member',image_user_id='03405619ccc741db816ae85847d709dc',network_allocated='True',owner_project_name='tempest-TestStampPattern-5890009',owner_user_name='tempest-TestStampPattern-5890009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:29:18Z,user_data=None,user_id='03405619ccc741db816ae85847d709dc',uuid=bdd23906-9be5-4f01-822c-35f87edadcfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converting VIF {"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6d:28,bridge_name='br-int',has_traffic_filtering=True,id=8c8022d9-b70f-4b18-9d63-515613278b2a,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8022d9-b7') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG os_vif [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6d:28,bridge_name='br-int',has_traffic_filtering=True,id=8c8022d9-b70f-4b18-9d63-515613278b2a,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8022d9-b7') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6ce5124-b514-5623-b315-4fa3d89b06a0', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c8022d9-b7, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c8022d9-b7, col_values=(('qos', UUID('a7fbaa07-60fb-4244-995f-9a5d44ef5e23')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c8022d9-b7, col_values=(('external_ids', {'iface-id': '8c8022d9-b70f-4b18-9d63-515613278b2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:6d:28', 'vm-uuid': 'bdd23906-9be5-4f01-822c-35f87edadcfd'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:21 user nova-compute[74482]: INFO os_vif [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6d:28,bridge_name='br-int',has_traffic_filtering=True,id=8c8022d9-b70f-4b18-9d63-515613278b2a,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8022d9-b7')
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:29:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No VIF found with MAC fa:16:3e:61:6d:28, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:29:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-b2cf1949-d038-4cd3-b71b-641f51d08a60 req-b23ddc89-7198-43aa-bea1-80f5d0702792 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received event network-vif-plugged-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:29:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b2cf1949-d038-4cd3-b71b-641f51d08a60 req-b23ddc89-7198-43aa-bea1-80f5d0702792 service nova] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b2cf1949-d038-4cd3-b71b-641f51d08a60 req-b23ddc89-7198-43aa-bea1-80f5d0702792 service nova] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b2cf1949-d038-4cd3-b71b-641f51d08a60 req-b23ddc89-7198-43aa-bea1-80f5d0702792 service nova] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-b2cf1949-d038-4cd3-b71b-641f51d08a60 req-b23ddc89-7198-43aa-bea1-80f5d0702792 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] No waiting events found dispatching network-vif-plugged-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:29:22 user nova-compute[74482]: WARNING nova.compute.manager [req-b2cf1949-d038-4cd3-b71b-641f51d08a60 req-b23ddc89-7198-43aa-bea1-80f5d0702792 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received unexpected event network-vif-plugged-8c8022d9-b70f-4b18-9d63-515613278b2a for instance with vm_state building and task_state spawning.
Oct 23 23:29:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:29:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Instance spawned successfully.
Oct 23 23:29:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:29:24 user nova-compute[74482]: INFO nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Took 6.53 seconds to spawn the instance on the hypervisor.
Oct 23 23:29:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-45f21216-9ce2-42b9-82cf-612fba567f68 req-5116f31e-1b9f-402f-8e16-1f8f74e4f372 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received event network-vif-plugged-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45f21216-9ce2-42b9-82cf-612fba567f68 req-5116f31e-1b9f-402f-8e16-1f8f74e4f372 service nova] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45f21216-9ce2-42b9-82cf-612fba567f68 req-5116f31e-1b9f-402f-8e16-1f8f74e4f372 service nova] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45f21216-9ce2-42b9-82cf-612fba567f68 req-5116f31e-1b9f-402f-8e16-1f8f74e4f372 service nova] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-45f21216-9ce2-42b9-82cf-612fba567f68 req-5116f31e-1b9f-402f-8e16-1f8f74e4f372 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] No waiting events found dispatching network-vif-plugged-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:29:24 user nova-compute[74482]: WARNING nova.compute.manager [req-45f21216-9ce2-42b9-82cf-612fba567f68 req-5116f31e-1b9f-402f-8e16-1f8f74e4f372 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received unexpected event network-vif-plugged-8c8022d9-b70f-4b18-9d63-515613278b2a for instance with vm_state building and task_state spawning.
Oct 23 23:29:24 user nova-compute[74482]: INFO nova.compute.manager [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Took 7.15 seconds to build instance.
Oct 23 23:29:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e313db96-5f85-47b4-89f3-27117a6fed2f tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.248s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:29:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:29:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:29:28 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:29:29 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updating instance_info_cache with network_info: [{"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:29:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:29:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:29:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:29:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:29:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:29:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:29:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:29:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:29:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:43 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:29:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:43 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:29:43 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:45 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:29:45 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:29:45 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=24.950180053710938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 193ff2db-80a1-406a-95f2-277c798fe86f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bdd23906-9be5-4f01-822c-35f87edadcfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:29:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-5c23d211-1d6a-43be-b36d-d8e1ad6ee718 req-b5d81c3a-b91b-44b9-90b6-31feb5a8bf65 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received event network-changed-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:29:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-5c23d211-1d6a-43be-b36d-d8e1ad6ee718 req-b5d81c3a-b91b-44b9-90b6-31feb5a8bf65 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Refreshing instance network info cache due to event network-changed-3e650827-f225-43df-85f3-caf2893e4e30. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:29:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5c23d211-1d6a-43be-b36d-d8e1ad6ee718 req-b5d81c3a-b91b-44b9-90b6-31feb5a8bf65 service nova] Acquiring lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:29:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5c23d211-1d6a-43be-b36d-d8e1ad6ee718 req-b5d81c3a-b91b-44b9-90b6-31feb5a8bf65 service nova] Acquired lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:29:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-5c23d211-1d6a-43be-b36d-d8e1ad6ee718 req-b5d81c3a-b91b-44b9-90b6-31feb5a8bf65 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Refreshing network info cache for port 3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:29:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-5c23d211-1d6a-43be-b36d-d8e1ad6ee718 req-b5d81c3a-b91b-44b9-90b6-31feb5a8bf65 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updated VIF entry in instance network info cache for port 3e650827-f225-43df-85f3-caf2893e4e30. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:29:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-5c23d211-1d6a-43be-b36d-d8e1ad6ee718 req-b5d81c3a-b91b-44b9-90b6-31feb5a8bf65 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updating instance_info_cache with network_info: [{"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:29:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5c23d211-1d6a-43be-b36d-d8e1ad6ee718 req-b5d81c3a-b91b-44b9-90b6-31feb5a8bf65 service nova] Releasing lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:29:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG nova.objects.instance [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'flavor' on Instance uuid 782d6230-1ba7-4b56-a77e-924ccdfd85d4 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:29:56 user nova-compute[74482]: INFO nova.compute.manager [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Attaching volume 84c2d329-2f10-4463-a0e2-c789548ac6f7 to /dev/vdb
Oct 23 23:29:56 user nova-compute[74482]: DEBUG os_brick.utils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f471ae2a-bd30-4abc-84dc-70608fa52c10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e32894f-179c-4d45-ba10-17af613697d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a411b57-2b6a-4ff6-bf05-183d1a4eb686]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73f1f25-6330-451b-9b99-718a93ad507f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:29:56 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:29:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc06df7-a0c8-494d-9969-8a28db071f32]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG os_brick.utils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:29:56 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updating existing volume attachment record: 8647b4a9-bc51-43cd-8102-47bdf559b7d7 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:29:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:29:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:30:08 user nova-compute[74482]: INFO nova.compute.claims [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Claim successful on node user
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:30:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.policy [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '158ff13b4023443190e1f9a4d36fb1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba7757462104f96812975fbc57a47c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:30:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Creating image(s)
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk 1073741824" returned: 0 in 0.058s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.network.neutron [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Successfully created port: 8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Cannot resize image /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Ensure instance console log exists: /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.network.neutron [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Successfully updated port: 8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquired lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.network.neutron [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-3d15f4cd-c5b8-422d-9811-e7bf60cbfb4e req-f9d32bb4-3c13-4dd6-adfb-ea1d40a435cb service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-changed-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-3d15f4cd-c5b8-422d-9811-e7bf60cbfb4e req-f9d32bb4-3c13-4dd6-adfb-ea1d40a435cb service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Refreshing instance network info cache due to event network-changed-8a005747-4659-4fda-8deb-613e576764a4. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3d15f4cd-c5b8-422d-9811-e7bf60cbfb4e req-f9d32bb4-3c13-4dd6-adfb-ea1d40a435cb service nova] Acquiring lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:30:09 user nova-compute[74482]: DEBUG nova.network.neutron [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.network.neutron [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Releasing lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance network_info: |[{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3d15f4cd-c5b8-422d-9811-e7bf60cbfb4e req-f9d32bb4-3c13-4dd6-adfb-ea1d40a435cb service nova] Acquired lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.network.neutron [req-3d15f4cd-c5b8-422d-9811-e7bf60cbfb4e req-f9d32bb4-3c13-4dd6-adfb-ea1d40a435cb service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Refreshing network info cache for port 8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Start _get_guest_xml network_info=[{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:30:10 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:30:10 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1723148553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1723148553',id=40,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGMkrNmuYgh+emqJ28fOaJ9AnU0YOEejFg6XrAS6jQeuSCmoBGIcfiuU+JPNCPQYAYcY3Bls0Q38wp8a9kLEAhDARfLcpDla/7289eQKE4Nq0D0fNeYg4aAcWzljSVdzQ==',key_name='tempest-keypair-1338837894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-f8a2l7gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=08a2d993-a54a-4001-a26a-cb2997b639a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.objects.instance [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'pci_devices' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:30:10 user nova-compute[74482]:   <uuid>08a2d993-a54a-4001-a26a-cb2997b639a0</uuid>
Oct 23 23:30:10 user nova-compute[74482]:   <name>instance-00000028</name>
Oct 23 23:30:10 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:30:10 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:30:10 user nova-compute[74482]:   <metadata>
Oct 23 23:30:10 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:30:10 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:30:10 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1723148553</nova:name>
Oct 23 23:30:10 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:30:10</nova:creationTime>
Oct 23 23:30:10 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:30:10 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:30:10 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:30:10 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:30:10 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:30:10 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:30:10 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:30:10 user nova-compute[74482]:       <nova:owner>
Oct 23 23:30:10 user nova-compute[74482]:         <nova:user uuid="158ff13b4023443190e1f9a4d36fb1a9">tempest-AttachVolumeShelveTestJSON-1885712928-project-member</nova:user>
Oct 23 23:30:10 user nova-compute[74482]:         <nova:project uuid="5ba7757462104f96812975fbc57a47c8">tempest-AttachVolumeShelveTestJSON-1885712928</nova:project>
Oct 23 23:30:10 user nova-compute[74482]:       </nova:owner>
Oct 23 23:30:10 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:30:10 user nova-compute[74482]:       <nova:ports>
Oct 23 23:30:10 user nova-compute[74482]:         <nova:port uuid="8a005747-4659-4fda-8deb-613e576764a4">
Oct 23 23:30:10 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 23:30:10 user nova-compute[74482]:         </nova:port>
Oct 23 23:30:10 user nova-compute[74482]:       </nova:ports>
Oct 23 23:30:10 user nova-compute[74482]:     </nova:instance>
Oct 23 23:30:10 user nova-compute[74482]:   </metadata>
Oct 23 23:30:10 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:30:10 user nova-compute[74482]:     <system>
Oct 23 23:30:10 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:30:10 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:30:10 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:30:10 user nova-compute[74482]:       <entry name="serial">08a2d993-a54a-4001-a26a-cb2997b639a0</entry>
Oct 23 23:30:10 user nova-compute[74482]:       <entry name="uuid">08a2d993-a54a-4001-a26a-cb2997b639a0</entry>
Oct 23 23:30:10 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:30:10 user nova-compute[74482]:     </system>
Oct 23 23:30:10 user nova-compute[74482]:   </sysinfo>
Oct 23 23:30:10 user nova-compute[74482]:   <os>
Oct 23 23:30:10 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:30:10 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:30:10 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:30:10 user nova-compute[74482]:   </os>
Oct 23 23:30:10 user nova-compute[74482]:   <features>
Oct 23 23:30:10 user nova-compute[74482]:     <acpi/>
Oct 23 23:30:10 user nova-compute[74482]:     <apic/>
Oct 23 23:30:10 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:30:10 user nova-compute[74482]:   </features>
Oct 23 23:30:10 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:30:10 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:30:10 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:30:10 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:30:10 user nova-compute[74482]:   </clock>
Oct 23 23:30:10 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:30:10 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:30:10 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:30:10 user nova-compute[74482]:   </cpu>
Oct 23 23:30:10 user nova-compute[74482]:   <devices>
Oct 23 23:30:10 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:30:10 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:30:10 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk"/>
Oct 23 23:30:10 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:30:10 user nova-compute[74482]:     </disk>
Oct 23 23:30:10 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:30:10 user nova-compute[74482]:       <mac address="fa:16:3e:24:cf:87"/>
Oct 23 23:30:10 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:30:10 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:30:10 user nova-compute[74482]:       <target dev="tap8a005747-46"/>
Oct 23 23:30:10 user nova-compute[74482]:     </interface>
Oct 23 23:30:10 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:30:10 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/console.log" append="off"/>
Oct 23 23:30:10 user nova-compute[74482]:     </serial>
Oct 23 23:30:10 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:30:10 user nova-compute[74482]:     <video>
Oct 23 23:30:10 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:30:10 user nova-compute[74482]:     </video>
Oct 23 23:30:10 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:30:10 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:30:10 user nova-compute[74482]:     </rng>
Oct 23 23:30:10 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:30:10 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:30:10 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:30:10 user nova-compute[74482]:     </memballoon>
Oct 23 23:30:10 user nova-compute[74482]:   </devices>
Oct 23 23:30:10 user nova-compute[74482]: </domain>
Oct 23 23:30:10 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1723148553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1723148553',id=40,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGMkrNmuYgh+emqJ28fOaJ9AnU0YOEejFg6XrAS6jQeuSCmoBGIcfiuU+JPNCPQYAYcY3Bls0Q38wp8a9kLEAhDARfLcpDla/7289eQKE4Nq0D0fNeYg4aAcWzljSVdzQ==',key_name='tempest-keypair-1338837894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-f8a2l7gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=08a2d993-a54a-4001-a26a-cb2997b639a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG os_vif [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'baf68f22-17ab-508d-a2d6-d63c163a160b', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a005747-46, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a005747-46, col_values=(('qos', UUID('e365bdbb-ca8a-4f63-a6b9-09d789e9ab5a')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a005747-46, col_values=(('external_ids', {'iface-id': '8a005747-4659-4fda-8deb-613e576764a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:cf:87', 'vm-uuid': '08a2d993-a54a-4001-a26a-cb2997b639a0'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:10 user nova-compute[74482]: INFO os_vif [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46')
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] No VIF found with MAC fa:16:3e:24:cf:87, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.network.neutron [req-3d15f4cd-c5b8-422d-9811-e7bf60cbfb4e req-f9d32bb4-3c13-4dd6-adfb-ea1d40a435cb service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updated VIF entry in instance network info cache for port 8a005747-4659-4fda-8deb-613e576764a4. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG nova.network.neutron [req-3d15f4cd-c5b8-422d-9811-e7bf60cbfb4e req-f9d32bb4-3c13-4dd6-adfb-ea1d40a435cb service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:30:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3d15f4cd-c5b8-422d-9811-e7bf60cbfb4e req-f9d32bb4-3c13-4dd6-adfb-ea1d40a435cb service nova] Releasing lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:30:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-4c15117d-e443-4269-84e9-5abc18d1aef5 req-2d090904-cef7-4cb9-9372-0d7242d10832 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:30:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4c15117d-e443-4269-84e9-5abc18d1aef5 req-2d090904-cef7-4cb9-9372-0d7242d10832 service nova] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4c15117d-e443-4269-84e9-5abc18d1aef5 req-2d090904-cef7-4cb9-9372-0d7242d10832 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4c15117d-e443-4269-84e9-5abc18d1aef5 req-2d090904-cef7-4cb9-9372-0d7242d10832 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-4c15117d-e443-4269-84e9-5abc18d1aef5 req-2d090904-cef7-4cb9-9372-0d7242d10832 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] No waiting events found dispatching network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:30:11 user nova-compute[74482]: WARNING nova.compute.manager [req-4c15117d-e443-4269-84e9-5abc18d1aef5 req-2d090904-cef7-4cb9-9372-0d7242d10832 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received unexpected event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 for instance with vm_state building and task_state spawning.
Oct 23 23:30:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:30:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance spawned successfully.
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:13 user nova-compute[74482]: INFO nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Took 5.13 seconds to spawn the instance on the hypervisor.
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-99e1abe1-3ee8-40e4-9092-73127cdccf1c req-9eae21b4-2412-4dd8-b35e-40d75f884d71 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-99e1abe1-3ee8-40e4-9092-73127cdccf1c req-9eae21b4-2412-4dd8-b35e-40d75f884d71 service nova] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-99e1abe1-3ee8-40e4-9092-73127cdccf1c req-9eae21b4-2412-4dd8-b35e-40d75f884d71 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-99e1abe1-3ee8-40e4-9092-73127cdccf1c req-9eae21b4-2412-4dd8-b35e-40d75f884d71 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-99e1abe1-3ee8-40e4-9092-73127cdccf1c req-9eae21b4-2412-4dd8-b35e-40d75f884d71 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] No waiting events found dispatching network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:30:13 user nova-compute[74482]: WARNING nova.compute.manager [req-99e1abe1-3ee8-40e4-9092-73127cdccf1c req-9eae21b4-2412-4dd8-b35e-40d75f884d71 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received unexpected event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 for instance with vm_state building and task_state spawning.
Oct 23 23:30:13 user nova-compute[74482]: INFO nova.compute.manager [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Took 5.77 seconds to build instance.
Oct 23 23:30:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-305f4d51-ab67-4f43-b9bc-f443620a36f2 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.883s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYuLqcva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:30:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:30:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:30:22 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[988862fd-54aa-4da7-a8a7-ed369b7b1a5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:30:22 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f69e83e-af21-48ca-b7f3-ee0f8b813823]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7] added
Oct 23 23:30:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c792c-85f8-4542-93b2-7d1e82ec4bb1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80325af-5431-4471-a1c4-38dd3aa8e47d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iYuLqcva {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iYuLqcva" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[952e6ea8-3009-4417-bb67-2031285a40f8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iYuLqcva'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d0a2c2-0065-4b60-b024-d725bad1934a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e77b7b2-c50d-48cb-8892-5604f9d1f5f2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:30:22 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:30:22 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:30:22 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:30:22 user nova-compute[74482]: 
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf883452-b749-456d-95c4-3416e7d48a69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7, portal: 172.16.0.220,3260]
Oct 23 23:30:22 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7, portal: 172.16.0.220,3260] successful.
Oct 23 23:30:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a884737e-ffee-40dd-94ff-5db615bb2087]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfab0a20-6714-4cde-9bb7-1390edaba66d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:30:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:30:22 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:30:22 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:23 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6658d0a7-4868-42f2-9b3c-49e4eaa5fa08]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:30:23 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYuLqcva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23438623231333963', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438623231333963', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG nova.objects.instance [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'flavor' on Instance uuid 782d6230-1ba7-4b56-a77e-924ccdfd85d4 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:30:24 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:30:24 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:30:24 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:30:24 user nova-compute[74482]:   <serial>84c2d329-2f10-4463-a0e2-c789548ac6f7</serial>
Oct 23 23:30:24 user nova-compute[74482]: </disk>
Oct 23 23:30:24 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No VIF found with MAC fa:16:3e:d7:ae:8b, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:30:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-aca1817b-03ec-469e-9fe6-75330e72bf76 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.992s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "5ca188ce-8c5a-456c-8326-e468f666797a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "5ca188ce-8c5a-456c-8326-e468f666797a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:27 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:30:28 user nova-compute[74482]: INFO nova.compute.claims [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Claim successful on node user
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:30:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.policy [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e723ee9b17d24a31b9d63246e0a6b054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f035fff650c45109cdf0779013139ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:30:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Creating image(s)
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "/opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "/opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk 1073741824" returned: 0 in 0.048s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Successfully created port: 60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.196s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Cannot resize image /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Ensure instance console log exists: /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Successfully updated port: 60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "refresh_cache-5ca188ce-8c5a-456c-8326-e468f666797a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquired lock "refresh_cache-5ca188ce-8c5a-456c-8326-e468f666797a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-f525b68d-c571-4afb-b608-879ef1ba889c req-3c3ff723-b2af-44f7-8f4e-616761099c0e service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received event network-changed-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-f525b68d-c571-4afb-b608-879ef1ba889c req-3c3ff723-b2af-44f7-8f4e-616761099c0e service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Refreshing instance network info cache due to event network-changed-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f525b68d-c571-4afb-b608-879ef1ba889c req-3c3ff723-b2af-44f7-8f4e-616761099c0e service nova] Acquiring lock "refresh_cache-5ca188ce-8c5a-456c-8326-e468f666797a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:30:29 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Updating instance_info_cache with network_info: [{"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Releasing lock "refresh_cache-5ca188ce-8c5a-456c-8326-e468f666797a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Instance network_info: |[{"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f525b68d-c571-4afb-b608-879ef1ba889c req-3c3ff723-b2af-44f7-8f4e-616761099c0e service nova] Acquired lock "refresh_cache-5ca188ce-8c5a-456c-8326-e468f666797a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.network.neutron [req-f525b68d-c571-4afb-b608-879ef1ba889c req-3c3ff723-b2af-44f7-8f4e-616761099c0e service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Refreshing network info cache for port 60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Start _get_guest_xml network_info=[{"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:30:30 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:30:30 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1859071801',display_name='tempest-AttachVolumeNegativeTest-server-1859071801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1859071801',id=41,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvVTii0JAxNELQDwrYx/eIVDQLvtFMqBzPwytGaROpLgVPiz9JkU6BxegexT2lkM/qgP3qRP4M69TPvdxATGCqX7IfNMe0GW05w54r0gtW9w4qrM19DqBy4/Y8Eqn4EOQ==',key_name='tempest-keypair-564846810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-4idc4z72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=5ca188ce-8c5a-456c-8326-e468f666797a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:a0:b4,bridge_name='br-int',has_traffic_filtering=True,id=60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60926e0a-6d') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ca188ce-8c5a-456c-8326-e468f666797a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:30:30 user nova-compute[74482]:   <uuid>5ca188ce-8c5a-456c-8326-e468f666797a</uuid>
Oct 23 23:30:30 user nova-compute[74482]:   <name>instance-00000029</name>
Oct 23 23:30:30 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:30:30 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:30:30 user nova-compute[74482]:   <metadata>
Oct 23 23:30:30 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:30:30 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:30:30 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1859071801</nova:name>
Oct 23 23:30:30 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:30:30</nova:creationTime>
Oct 23 23:30:30 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:30:30 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:30:30 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:30:30 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:30:30 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:30:30 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:30:30 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:30:30 user nova-compute[74482]:       <nova:owner>
Oct 23 23:30:30 user nova-compute[74482]:         <nova:user uuid="e723ee9b17d24a31b9d63246e0a6b054">tempest-AttachVolumeNegativeTest-873141491-project-member</nova:user>
Oct 23 23:30:30 user nova-compute[74482]:         <nova:project uuid="4f035fff650c45109cdf0779013139ff">tempest-AttachVolumeNegativeTest-873141491</nova:project>
Oct 23 23:30:30 user nova-compute[74482]:       </nova:owner>
Oct 23 23:30:30 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:30:30 user nova-compute[74482]:       <nova:ports>
Oct 23 23:30:30 user nova-compute[74482]:         <nova:port uuid="60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f">
Oct 23 23:30:30 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 23:30:30 user nova-compute[74482]:         </nova:port>
Oct 23 23:30:30 user nova-compute[74482]:       </nova:ports>
Oct 23 23:30:30 user nova-compute[74482]:     </nova:instance>
Oct 23 23:30:30 user nova-compute[74482]:   </metadata>
Oct 23 23:30:30 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:30:30 user nova-compute[74482]:     <system>
Oct 23 23:30:30 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:30:30 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:30:30 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:30:30 user nova-compute[74482]:       <entry name="serial">5ca188ce-8c5a-456c-8326-e468f666797a</entry>
Oct 23 23:30:30 user nova-compute[74482]:       <entry name="uuid">5ca188ce-8c5a-456c-8326-e468f666797a</entry>
Oct 23 23:30:30 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:30:30 user nova-compute[74482]:     </system>
Oct 23 23:30:30 user nova-compute[74482]:   </sysinfo>
Oct 23 23:30:30 user nova-compute[74482]:   <os>
Oct 23 23:30:30 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:30:30 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:30:30 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:30:30 user nova-compute[74482]:   </os>
Oct 23 23:30:30 user nova-compute[74482]:   <features>
Oct 23 23:30:30 user nova-compute[74482]:     <acpi/>
Oct 23 23:30:30 user nova-compute[74482]:     <apic/>
Oct 23 23:30:30 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:30:30 user nova-compute[74482]:   </features>
Oct 23 23:30:30 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:30:30 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:30:30 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:30:30 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:30:30 user nova-compute[74482]:   </clock>
Oct 23 23:30:30 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:30:30 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:30:30 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:30:30 user nova-compute[74482]:   </cpu>
Oct 23 23:30:30 user nova-compute[74482]:   <devices>
Oct 23 23:30:30 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:30:30 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:30:30 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk"/>
Oct 23 23:30:30 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:30:30 user nova-compute[74482]:     </disk>
Oct 23 23:30:30 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:30:30 user nova-compute[74482]:       <mac address="fa:16:3e:23:a0:b4"/>
Oct 23 23:30:30 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:30:30 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:30:30 user nova-compute[74482]:       <target dev="tap60926e0a-6d"/>
Oct 23 23:30:30 user nova-compute[74482]:     </interface>
Oct 23 23:30:30 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:30:30 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/console.log" append="off"/>
Oct 23 23:30:30 user nova-compute[74482]:     </serial>
Oct 23 23:30:30 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:30:30 user nova-compute[74482]:     <video>
Oct 23 23:30:30 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:30:30 user nova-compute[74482]:     </video>
Oct 23 23:30:30 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:30:30 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:30:30 user nova-compute[74482]:     </rng>
Oct 23 23:30:30 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:30:30 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:30:30 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:30:30 user nova-compute[74482]:     </memballoon>
Oct 23 23:30:30 user nova-compute[74482]:   </devices>
Oct 23 23:30:30 user nova-compute[74482]: </domain>
Oct 23 23:30:30 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1859071801',display_name='tempest-AttachVolumeNegativeTest-server-1859071801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1859071801',id=41,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvVTii0JAxNELQDwrYx/eIVDQLvtFMqBzPwytGaROpLgVPiz9JkU6BxegexT2lkM/qgP3qRP4M69TPvdxATGCqX7IfNMe0GW05w54r0gtW9w4qrM19DqBy4/Y8Eqn4EOQ==',key_name='tempest-keypair-564846810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-4idc4z72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=5ca188ce-8c5a-456c-8326-e468f666797a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:a0:b4,bridge_name='br-int',has_traffic_filtering=True,id=60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60926e0a-6d') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG os_vif [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:a0:b4,bridge_name='br-int',has_traffic_filtering=True,id=60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60926e0a-6d') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f69f56f-65b1-56ab-baaf-b10e447e33d6', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60926e0a-6d, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60926e0a-6d, col_values=(('qos', UUID('041bf850-dcc9-4d58-aea7-8db77579be95')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60926e0a-6d, col_values=(('external_ids', {'iface-id': '60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:a0:b4', 'vm-uuid': '5ca188ce-8c5a-456c-8326-e468f666797a'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:30 user nova-compute[74482]: INFO os_vif [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:a0:b4,bridge_name='br-int',has_traffic_filtering=True,id=60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60926e0a-6d')
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updating instance_info_cache with network_info: [{"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No VIF found with MAC fa:16:3e:23:a0:b4, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.network.neutron [req-f525b68d-c571-4afb-b608-879ef1ba889c req-3c3ff723-b2af-44f7-8f4e-616761099c0e service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Updated VIF entry in instance network info cache for port 60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG nova.network.neutron [req-f525b68d-c571-4afb-b608-879ef1ba889c req-3c3ff723-b2af-44f7-8f4e-616761099c0e service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Updating instance_info_cache with network_info: [{"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:30:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f525b68d-c571-4afb-b608-879ef1ba889c req-3c3ff723-b2af-44f7-8f4e-616761099c0e service nova] Releasing lock "refresh_cache-5ca188ce-8c5a-456c-8326-e468f666797a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-30962300-7032-40b0-bbe4-082b76b986bf req-e81044ad-3e7d-437f-8a0c-aad3954ec87f service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received event network-vif-plugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-30962300-7032-40b0-bbe4-082b76b986bf req-e81044ad-3e7d-437f-8a0c-aad3954ec87f service nova] Acquiring lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-30962300-7032-40b0-bbe4-082b76b986bf req-e81044ad-3e7d-437f-8a0c-aad3954ec87f service nova] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-30962300-7032-40b0-bbe4-082b76b986bf req-e81044ad-3e7d-437f-8a0c-aad3954ec87f service nova] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-30962300-7032-40b0-bbe4-082b76b986bf req-e81044ad-3e7d-437f-8a0c-aad3954ec87f service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] No waiting events found dispatching network-vif-plugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:30:31 user nova-compute[74482]: WARNING nova.compute.manager [req-30962300-7032-40b0-bbe4-082b76b986bf req-e81044ad-3e7d-437f-8a0c-aad3954ec87f service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received unexpected event network-vif-plugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f for instance with vm_state building and task_state spawning.
Oct 23 23:30:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:30:32 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:30:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Instance spawned successfully.
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a813d85-8da9-4879-a255-026a9f56fb8f req-cb6379c3-8a09-4866-9fd5-86e9c9e10c23 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received event network-vif-plugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a813d85-8da9-4879-a255-026a9f56fb8f req-cb6379c3-8a09-4866-9fd5-86e9c9e10c23 service nova] Acquiring lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a813d85-8da9-4879-a255-026a9f56fb8f req-cb6379c3-8a09-4866-9fd5-86e9c9e10c23 service nova] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a813d85-8da9-4879-a255-026a9f56fb8f req-cb6379c3-8a09-4866-9fd5-86e9c9e10c23 service nova] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a813d85-8da9-4879-a255-026a9f56fb8f req-cb6379c3-8a09-4866-9fd5-86e9c9e10c23 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] No waiting events found dispatching network-vif-plugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:30:33 user nova-compute[74482]: WARNING nova.compute.manager [req-2a813d85-8da9-4879-a255-026a9f56fb8f req-cb6379c3-8a09-4866-9fd5-86e9c9e10c23 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received unexpected event network-vif-plugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f for instance with vm_state building and task_state spawning.
Oct 23 23:30:33 user nova-compute[74482]: INFO nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Took 5.13 seconds to spawn the instance on the hypervisor.
Oct 23 23:30:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:30:33 user nova-compute[74482]: INFO nova.compute.manager [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Took 5.77 seconds to build instance.
Oct 23 23:30:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a620de2-a5c9-46e0-9fb4-1437063157e2 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "5ca188ce-8c5a-456c-8326-e468f666797a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.861s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:30:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:44 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:44 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:30:44 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:45 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:30:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:30:47 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:30:47 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8312MB free_disk=24.910015106201172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 193ff2db-80a1-406a-95f2-277c798fe86f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bdd23906-9be5-4f01-822c-35f87edadcfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 08a2d993-a54a-4001-a26a-cb2997b639a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 5ca188ce-8c5a-456c-8326-e468f666797a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:30:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:30:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:30:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:30:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-8490a4e0-36d3-4f4c-8e07-975506d5959a req-033fa834-8dea-41b0-a349-c8bc61ded57a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received event network-changed-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-8490a4e0-36d3-4f4c-8e07-975506d5959a req-033fa834-8dea-41b0-a349-c8bc61ded57a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Refreshing instance network info cache due to event network-changed-8c8022d9-b70f-4b18-9d63-515613278b2a. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8490a4e0-36d3-4f4c-8e07-975506d5959a req-033fa834-8dea-41b0-a349-c8bc61ded57a service nova] Acquiring lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8490a4e0-36d3-4f4c-8e07-975506d5959a req-033fa834-8dea-41b0-a349-c8bc61ded57a service nova] Acquired lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-8490a4e0-36d3-4f4c-8e07-975506d5959a req-033fa834-8dea-41b0-a349-c8bc61ded57a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Refreshing network info cache for port 8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-8490a4e0-36d3-4f4c-8e07-975506d5959a req-033fa834-8dea-41b0-a349-c8bc61ded57a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Updated VIF entry in instance network info cache for port 8c8022d9-b70f-4b18-9d63-515613278b2a. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-8490a4e0-36d3-4f4c-8e07-975506d5959a req-033fa834-8dea-41b0-a349-c8bc61ded57a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Updating instance_info_cache with network_info: [{"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8490a4e0-36d3-4f4c-8e07-975506d5959a req-033fa834-8dea-41b0-a349-c8bc61ded57a service nova] Releasing lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:31:09 user nova-compute[74482]: DEBUG nova.objects.instance [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'flavor' on Instance uuid bdd23906-9be5-4f01-822c-35f87edadcfd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:31:10 user nova-compute[74482]: INFO nova.compute.manager [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Attaching volume caadc6b9-6f10-402e-a8a0-e576284e607a to /dev/vdb
Oct 23 23:31:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG os_brick.utils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac7afa5-fae1-4629-951b-6a27bc86bb2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f1f2b-50c3-4621-9591-d53106e9d927]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[debe972d-227e-4d34-ad93-3d5ec305b608]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a1a49-ada9-4cd2-acdb-1c1b28e2c164]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:31:10 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:31:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[374382fe-e42c-4334-85c5-d642e77020fd]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG os_brick.utils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:31:10 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Updating existing volume attachment record: 09ba34e3-8c7f-4c29-8faa-709f5eb8a23c {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:31:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOqFbsdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:31:26 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:31:26 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:31:26 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99df4146-dbd9-4352-8d48-1ce965173a2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:31:26 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cdd23f-f09c-4693-b4f8-e080964a1bdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a] added
Oct 23 23:31:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f92692-accd-46ca-8433-ab52ec7500d1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d6853a-f193-4f34-9512-929a0c5ce2ec]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOqFbsdk {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOqFbsdk" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b1789-32b1-4cac-9caf-b08f11a99fea]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SOqFbsdk'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b88fbab-29c2-45ee-ab6b-7cc71ec62bab]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdb2716-6a93-4faf-bd2d-f4883829bf7e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:31:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:31:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a55ef2-0249-47e1-bc9c-c97cc7977593]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a, portal: 172.16.0.220,3260]
Oct 23 23:31:26 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a, portal: 172.16.0.220,3260] successful.
Oct 23 23:31:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d2c2d-c8d9-4349-bbab-89f8c4f2c779]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af4aac-d22f-48ed-9e72-ae8022cd7622]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:31:26 user nova-compute[74482]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a (non-flash)
Oct 23 23:31:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:31:26 user nova-compute[74482]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a (non-flash)
Oct 23 23:31:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:31:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:27 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f97696-ed8a-441b-912a-99078b401bbf]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:27 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:31:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOqFbsdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:31:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:31:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23637326430333835', 'path': '/dev/sdc'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:31:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637326430333835', 'path': '/dev/sdc'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:31:28 user nova-compute[74482]: DEBUG nova.objects.instance [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'flavor' on Instance uuid bdd23906-9be5-4f01-822c-35f87edadcfd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:31:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:31:28 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:31:28 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:31:28 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:31:28 user nova-compute[74482]:   <serial>caadc6b9-6f10-402e-a8a0-e576284e607a</serial>
Oct 23 23:31:28 user nova-compute[74482]: </disk>
Oct 23 23:31:28 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:31:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:31:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:31:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] No VIF found with MAC fa:16:3e:61:6d:28, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:31:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-cab22520-1e36-491a-bdd5-3b0ee23f7fcf tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.441s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:31:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:31:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 193ff2db-80a1-406a-95f2-277c798fe86f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:31:30 user nova-compute[74482]: INFO nova.compute.manager [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Detaching volume caadc6b9-6f10-402e-a8a0-e576284e607a
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updating instance_info_cache with network_info: [{"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:31:30 user nova-compute[74482]: INFO nova.virt.block_device [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Attempting to driver detach volume caadc6b9-6f10-402e-a8a0-e576284e607a from mountpoint /dev/vdb
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Attempting to detach device vdb from instance bdd23906-9be5-4f01-822c-35f87edadcfd from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:31:30 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:31:30 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:31:30 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:31:30 user nova-compute[74482]:   <serial>caadc6b9-6f10-402e-a8a0-e576284e607a</serial>
Oct 23 23:31:30 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:31:30 user nova-compute[74482]: </disk>
Oct 23 23:31:30 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:31:30 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Successfully detached device vdb from instance bdd23906-9be5-4f01-822c-35f87edadcfd from the persistent domain config.
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdd23906-9be5-4f01-822c-35f87edadcfd from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:31:30 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:31:30 user nova-compute[74482]:   <source dev="/dev/sdc"/>
Oct 23 23:31:30 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:31:30 user nova-compute[74482]:   <serial>caadc6b9-6f10-402e-a8a0-e576284e607a</serial>
Oct 23 23:31:30 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:31:30 user nova-compute[74482]: </disk>
Oct 23 23:31:30 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:31:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdd23906-9be5-4f01-822c-35f87edadcfd {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:31:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:31:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:31:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:31:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:31:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:31:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:31:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:31:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:31:46 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:31:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:31:49 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:31:49 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8464MB free_disk=24.88109588623047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 193ff2db-80a1-406a-95f2-277c798fe86f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance bdd23906-9be5-4f01-822c-35f87edadcfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 08a2d993-a54a-4001-a26a-cb2997b639a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 5ca188ce-8c5a-456c-8326-e468f666797a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:31:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:31:50 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdd23906-9be5-4f01-822c-35f87edadcfd is timed out.
Oct 23 23:31:50 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Successfully detached device vdb from instance bdd23906-9be5-4f01-822c-35f87edadcfd from the live domain config.
Oct 23 23:31:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOqFbsdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:31:50 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:31:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f59f4f-e546-4eb2-bab5-9b9479da955c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:31:50 user nova-compute[74482]: No targets found.
Oct 23 23:31:50 user nova-compute[74482]: iSNS:
Oct 23 23:31:50 user nova-compute[74482]: No targets found.
Oct 23 23:31:50 user nova-compute[74482]: STATIC:
Oct 23 23:31:50 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7
Oct 23 23:31:50 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:31:50 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:31:50 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a
Oct 23 23:31:50 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:31:50 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:31:50 user nova-compute[74482]: FIRMWARE:
Oct 23 23:31:50 user nova-compute[74482]: No targets found.
Oct 23 23:31:50 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:31:50 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:31:50 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:31:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7ebb69-8826-4f7c-9a9d-3d6aa4055bda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1779b3-a8d9-452f-8337-368f70a4684c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:31:51 user nova-compute[74482]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a (non-flash)
Oct 23 23:31:51 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:31:51 user nova-compute[74482]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a (non-flash)
Oct 23 23:31:51 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f304c7c2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a'): ({'sdc'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Removing single pathed devices sdc {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c4c7c2-c529-4125-8d1d-bb1316c7777b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca2c953-6cce-4c33-9ac2-d48a848f4d82]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Flushing IO for device /dev/sdc {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263bf4a-483f-49b4-9d1d-fcc3af3b33c2]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b28a4d1-7cc8-407a-b6b6-b1d7efe0ba8e]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f18b0cb-6949-4859-9d07-d3ea5771e899]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cf81c4-64a4-4b78-bb40-e6d3e73603a1]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a, portal: 172.16.0.220,3260]
Oct 23 23:31:51 user nova-compute[74482]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a, portal: 172.16.0.220,3260] successful.
Oct 23 23:31:51 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caadc6b9-6f10-402e-a8a0-e576284e607a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf8d05-47f4-42d8-951b-b98fddcc07f7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] <== disconnect_volume: return (288ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:31:51 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:31:52 user nova-compute[74482]: DEBUG nova.objects.instance [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'flavor' on Instance uuid bdd23906-9be5-4f01-822c-35f87edadcfd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:31:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-dda957df-6b2a-4e14-8458-58458cec4382 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.662s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:31:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-4dcbb8d0-768d-47ae-b5c5-c4619a73bd37 req-521c8afd-3f83-456e-a714-4c8cf29f89ad service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-changed-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:31:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-4dcbb8d0-768d-47ae-b5c5-c4619a73bd37 req-521c8afd-3f83-456e-a714-4c8cf29f89ad service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Refreshing instance network info cache due to event network-changed-8a005747-4659-4fda-8deb-613e576764a4. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:31:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4dcbb8d0-768d-47ae-b5c5-c4619a73bd37 req-521c8afd-3f83-456e-a714-4c8cf29f89ad service nova] Acquiring lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:31:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4dcbb8d0-768d-47ae-b5c5-c4619a73bd37 req-521c8afd-3f83-456e-a714-4c8cf29f89ad service nova] Acquired lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:31:59 user nova-compute[74482]: DEBUG nova.network.neutron [req-4dcbb8d0-768d-47ae-b5c5-c4619a73bd37 req-521c8afd-3f83-456e-a714-4c8cf29f89ad service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Refreshing network info cache for port 8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:31:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:31:59 user nova-compute[74482]: DEBUG nova.network.neutron [req-4dcbb8d0-768d-47ae-b5c5-c4619a73bd37 req-521c8afd-3f83-456e-a714-4c8cf29f89ad service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updated VIF entry in instance network info cache for port 8a005747-4659-4fda-8deb-613e576764a4. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:31:59 user nova-compute[74482]: DEBUG nova.network.neutron [req-4dcbb8d0-768d-47ae-b5c5-c4619a73bd37 req-521c8afd-3f83-456e-a714-4c8cf29f89ad service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:31:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4dcbb8d0-768d-47ae-b5c5-c4619a73bd37 req-521c8afd-3f83-456e-a714-4c8cf29f89ad service nova] Releasing lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:32:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:05 user nova-compute[74482]: INFO nova.compute.manager [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Shelving
Oct 23 23:32:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-724b91f3-27bf-4739-87ad-1cf7d73b879d req-c07c4ad2-55c2-42e4-a4bb-de11ed3c5c88 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-unplugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-724b91f3-27bf-4739-87ad-1cf7d73b879d req-c07c4ad2-55c2-42e4-a4bb-de11ed3c5c88 service nova] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-724b91f3-27bf-4739-87ad-1cf7d73b879d req-c07c4ad2-55c2-42e4-a4bb-de11ed3c5c88 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-724b91f3-27bf-4739-87ad-1cf7d73b879d req-c07c4ad2-55c2-42e4-a4bb-de11ed3c5c88 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:05 user nova-compute[74482]: DEBUG nova.compute.manager [req-724b91f3-27bf-4739-87ad-1cf7d73b879d req-c07c4ad2-55c2-42e4-a4bb-de11ed3c5c88 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] No waiting events found dispatching network-vif-unplugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:32:05 user nova-compute[74482]: WARNING nova.compute.manager [req-724b91f3-27bf-4739-87ad-1cf7d73b879d req-c07c4ad2-55c2-42e4-a4bb-de11ed3c5c88 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received unexpected event network-vif-unplugged-8a005747-4659-4fda-8deb-613e576764a4 for instance with vm_state active and task_state shelving.
Oct 23 23:32:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance destroyed successfully.
Oct 23 23:32:05 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Beginning cold snapshot process
Oct 23 23:32:06 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:32:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk /opt/stack/data/nova/instances/snapshots/tmp9s7uuqe2/aab7b97f9b21422aa2e6bcb0cf36d5fe {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:32:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk /opt/stack/data/nova/instances/snapshots/tmp9s7uuqe2/aab7b97f9b21422aa2e6bcb0cf36d5fe" returned: 0 in 0.390s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:32:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Snapshot extracted, beginning image upload
Oct 23 23:32:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-356952b6-cb30-444c-8461-e742975b8ec9 req-748f27b7-8346-4a76-a9b7-1b6d8681279a service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-356952b6-cb30-444c-8461-e742975b8ec9 req-748f27b7-8346-4a76-a9b7-1b6d8681279a service nova] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-356952b6-cb30-444c-8461-e742975b8ec9 req-748f27b7-8346-4a76-a9b7-1b6d8681279a service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-356952b6-cb30-444c-8461-e742975b8ec9 req-748f27b7-8346-4a76-a9b7-1b6d8681279a service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-356952b6-cb30-444c-8461-e742975b8ec9 req-748f27b7-8346-4a76-a9b7-1b6d8681279a service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] No waiting events found dispatching network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:32:07 user nova-compute[74482]: WARNING nova.compute.manager [req-356952b6-cb30-444c-8461-e742975b8ec9 req-748f27b7-8346-4a76-a9b7-1b6d8681279a service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received unexpected event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 for instance with vm_state active and task_state shelving_image_uploading.
Oct 23 23:32:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Snapshot image upload complete
Oct 23 23:32:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:32:08 user nova-compute[74482]: INFO nova.compute.manager [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Shelve offloading
Oct 23 23:32:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance destroyed successfully.
Oct 23 23:32:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:32:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:32:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquired lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:32:08 user nova-compute[74482]: DEBUG nova.network.neutron [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG nova.network.neutron [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Releasing lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance destroyed successfully.
Oct 23 23:32:09 user nova-compute[74482]: DEBUG nova.objects.instance [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'resources' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1723148553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1723148553',id=40,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGMkrNmuYgh+emqJ28fOaJ9AnU0YOEejFg6XrAS6jQeuSCmoBGIcfiuU+JPNCPQYAYcY3Bls0Q38wp8a9kLEAhDARfLcpDla/7289eQKE4Nq0D0fNeYg4aAcWzljSVdzQ==',key_name='tempest-keypair-1338837894',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:30:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-f8a2l7gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member',shelved_at='2023-10-23T23:32:08.728975',shelved_host='user',shelved_image_id='12bc0f52-c9ec-4d78-87ec-d451916acf1d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=08a2d993-a54a-4001-a26a-cb2997b639a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG os_vif [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a005747-46, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e365bdbb-ca8a-4f63-a6b9-09d789e9ab5a) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:32:09 user nova-compute[74482]: INFO os_vif [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46')
Oct 23 23:32:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Deleting instance files /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0_del
Oct 23 23:32:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Deletion of /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0_del complete
Oct 23 23:32:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-a44ef6c1-510f-441b-a7d2-73f3c10dba1f req-7217e4e7-6504-42e5-a705-3f6384b8f095 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-changed-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-a44ef6c1-510f-441b-a7d2-73f3c10dba1f req-7217e4e7-6504-42e5-a705-3f6384b8f095 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Refreshing instance network info cache due to event network-changed-8a005747-4659-4fda-8deb-613e576764a4. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a44ef6c1-510f-441b-a7d2-73f3c10dba1f req-7217e4e7-6504-42e5-a705-3f6384b8f095 service nova] Acquiring lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a44ef6c1-510f-441b-a7d2-73f3c10dba1f req-7217e4e7-6504-42e5-a705-3f6384b8f095 service nova] Acquired lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:32:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-a44ef6c1-510f-441b-a7d2-73f3c10dba1f req-7217e4e7-6504-42e5-a705-3f6384b8f095 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Refreshing network info cache for port 8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:32:10 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Deleted allocations for instance 08a2d993-a54a-4001-a26a-cb2997b639a0
Oct 23 23:32:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG nova.objects.instance [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'numa_topology' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG nova.objects.base [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<08a2d993-a54a-4001-a26a-cb2997b639a0> lazy-loaded attributes: resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG nova.network.neutron [req-a44ef6c1-510f-441b-a7d2-73f3c10dba1f req-7217e4e7-6504-42e5-a705-3f6384b8f095 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updated VIF entry in instance network info cache for port 8a005747-4659-4fda-8deb-613e576764a4. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG nova.network.neutron [req-a44ef6c1-510f-441b-a7d2-73f3c10dba1f req-7217e4e7-6504-42e5-a705-3f6384b8f095 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8a005747-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-01f65448-e404-43a0-ad6c-adfa49c2cfeb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.207s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a44ef6c1-510f-441b-a7d2-73f3c10dba1f req-7217e4e7-6504-42e5-a705-3f6384b8f095 service nova] Releasing lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:32:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-2be92b36-3397-4ecb-b442-f73a26819bdd req-ed467f0d-0cac-45d8-905e-56c2ce8740cd service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received event network-changed-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:18 user nova-compute[74482]: DEBUG nova.compute.manager [req-2be92b36-3397-4ecb-b442-f73a26819bdd req-ed467f0d-0cac-45d8-905e-56c2ce8740cd service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Refreshing instance network info cache due to event network-changed-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:32:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2be92b36-3397-4ecb-b442-f73a26819bdd req-ed467f0d-0cac-45d8-905e-56c2ce8740cd service nova] Acquiring lock "refresh_cache-5ca188ce-8c5a-456c-8326-e468f666797a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:32:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2be92b36-3397-4ecb-b442-f73a26819bdd req-ed467f0d-0cac-45d8-905e-56c2ce8740cd service nova] Acquired lock "refresh_cache-5ca188ce-8c5a-456c-8326-e468f666797a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:32:18 user nova-compute[74482]: DEBUG nova.network.neutron [req-2be92b36-3397-4ecb-b442-f73a26819bdd req-ed467f0d-0cac-45d8-905e-56c2ce8740cd service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Refreshing network info cache for port 60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG nova.network.neutron [req-2be92b36-3397-4ecb-b442-f73a26819bdd req-ed467f0d-0cac-45d8-905e-56c2ce8740cd service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Updated VIF entry in instance network info cache for port 60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG nova.network.neutron [req-2be92b36-3397-4ecb-b442-f73a26819bdd req-ed467f0d-0cac-45d8-905e-56c2ce8740cd service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Updating instance_info_cache with network_info: [{"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "5ca188ce-8c5a-456c-8326-e468f666797a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "5ca188ce-8c5a-456c-8326-e468f666797a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2be92b36-3397-4ecb-b442-f73a26819bdd req-ed467f0d-0cac-45d8-905e-56c2ce8740cd service nova] Releasing lock "refresh_cache-5ca188ce-8c5a-456c-8326-e468f666797a" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:32:19 user nova-compute[74482]: INFO nova.compute.manager [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Terminating instance
Oct 23 23:32:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Instance destroyed successfully.
Oct 23 23:32:19 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'resources' on Instance uuid 5ca188ce-8c5a-456c-8326-e468f666797a {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:30:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1859071801',display_name='tempest-AttachVolumeNegativeTest-server-1859071801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1859071801',id=41,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvVTii0JAxNELQDwrYx/eIVDQLvtFMqBzPwytGaROpLgVPiz9JkU6BxegexT2lkM/qgP3qRP4M69TPvdxATGCqX7IfNMe0GW05w54r0gtW9w4qrM19DqBy4/Y8Eqn4EOQ==',key_name='tempest-keypair-564846810',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:30:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-4idc4z72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:30:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=5ca188ce-8c5a-456c-8326-e468f666797a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "address": "fa:16:3e:23:a0:b4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60926e0a-6d", "ovs_interfaceid": "60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:a0:b4,bridge_name='br-int',has_traffic_filtering=True,id=60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60926e0a-6d') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG os_vif [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:a0:b4,bridge_name='br-int',has_traffic_filtering=True,id=60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60926e0a-6d') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60926e0a-6d, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=041bf850-dcc9-4d58-aea7-8db77579be95) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:32:19 user nova-compute[74482]: INFO os_vif [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:a0:b4,bridge_name='br-int',has_traffic_filtering=True,id=60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60926e0a-6d')
Oct 23 23:32:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Deleting instance files /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a_del
Oct 23 23:32:19 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Deletion of /opt/stack/data/nova/instances/5ca188ce-8c5a-456c-8326-e468f666797a_del complete
Oct 23 23:32:19 user nova-compute[74482]: INFO nova.compute.manager [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Took 0.66 seconds to destroy the instance on the hypervisor.
Oct 23 23:32:19 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:32:19 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-ce78e311-ab1a-43c6-a0df-89fbe2f88640 req-90e9d9ca-4bfb-4eb9-89ee-00ff3e252056 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received event network-vif-deleted-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:20 user nova-compute[74482]: INFO nova.compute.manager [req-ce78e311-ab1a-43c6-a0df-89fbe2f88640 req-90e9d9ca-4bfb-4eb9-89ee-00ff3e252056 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Neutron deleted interface 60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f; detaching it from the instance and deleting it from the info cache
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-ce78e311-ab1a-43c6-a0df-89fbe2f88640 req-90e9d9ca-4bfb-4eb9-89ee-00ff3e252056 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:32:20 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Took 0.62 seconds to deallocate network for instance.
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-ce78e311-ab1a-43c6-a0df-89fbe2f88640 req-90e9d9ca-4bfb-4eb9-89ee-00ff3e252056 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Detach interface failed, port_id=60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f, reason: Instance 5ca188ce-8c5a-456c-8326-e468f666797a could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:20 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Deleted allocations for instance 5ca188ce-8c5a-456c-8326-e468f666797a
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e329c71d-a401-4ee1-b24d-8e27eea4da58 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "5ca188ce-8c5a-456c-8326-e468f666797a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.643s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received event network-vif-unplugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] Acquiring lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] No waiting events found dispatching network-vif-unplugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:32:20 user nova-compute[74482]: WARNING nova.compute.manager [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received unexpected event network-vif-unplugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f for instance with vm_state deleted and task_state None.
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received event network-vif-plugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] Acquiring lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] Lock "5ca188ce-8c5a-456c-8326-e468f666797a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] No waiting events found dispatching network-vif-plugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:32:20 user nova-compute[74482]: WARNING nova.compute.manager [req-f22feb33-17a7-4791-97a6-5dce72a2b485 req-26814ae5-69d5-419f-b932-6348f2e90762 service nova] [instance: 5ca188ce-8c5a-456c-8326-e468f666797a] Received unexpected event network-vif-plugged-60926e0a-6d7c-4799-ac9b-6d4d3f0e6a1f for instance with vm_state deleted and task_state None.
Oct 23 23:32:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:21 user nova-compute[74482]: INFO nova.compute.manager [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Terminating instance
Oct 23 23:32:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:21 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Instance destroyed successfully.
Oct 23 23:32:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'resources' on Instance uuid bdd23906-9be5-4f01-822c-35f87edadcfd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-32898761',display_name='tempest-TestStampPattern-server-32898761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-32898761',id=39,image_ref='b273a9f8-5b9d-4b0b-8ea7-883509cfa094',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7YQZm1GfqtZoOS480LjJpdLzFfHr8ohWltRZjWaUsDY7dilvyzekzrkZYBE59rzhwwvndw38f2+LRwrE6/EhfokssEcMuybAOSKBD0XCZ5rgLApMr4Fjos3ZmCSubEKQ==',key_name='tempest-TestStampPattern-726908670',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:29:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5990acffa754d12b9bb47fc0f44f0e8',ramdisk_id='',reservation_id='r-1e61p064',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='193ff2db-80a1-406a-95f2-277c798fe86f',image_min_disk='1',image_min_ram='0',image_owner_id='f5990acffa754d12b9bb47fc0f44f0e8',image_owner_project_name='tempest-TestStampPattern-5890009',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-5890009-project-member',image_user_id='03405619ccc741db816ae85847d709dc',owner_project_name='tempest-TestStampPattern-5890009',owner_user_name='tempest-TestStampPattern-5890009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:29:25Z,user_data=None,user_id='03405619ccc741db816ae85847d709dc',uuid=bdd23906-9be5-4f01-822c-35f87edadcfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converting VIF {"id": "8c8022d9-b70f-4b18-9d63-515613278b2a", "address": "fa:16:3e:61:6d:28", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8022d9-b7", "ovs_interfaceid": "8c8022d9-b70f-4b18-9d63-515613278b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:6d:28,bridge_name='br-int',has_traffic_filtering=True,id=8c8022d9-b70f-4b18-9d63-515613278b2a,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8022d9-b7') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG os_vif [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:6d:28,bridge_name='br-int',has_traffic_filtering=True,id=8c8022d9-b70f-4b18-9d63-515613278b2a,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8022d9-b7') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c8022d9-b7, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7fbaa07-60fb-4244-995f-9a5d44ef5e23) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:32:21 user nova-compute[74482]: INFO os_vif [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:6d:28,bridge_name='br-int',has_traffic_filtering=True,id=8c8022d9-b70f-4b18-9d63-515613278b2a,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8022d9-b7')
Oct 23 23:32:21 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Deleting instance files /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd_del
Oct 23 23:32:21 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Deletion of /opt/stack/data/nova/instances/bdd23906-9be5-4f01-822c-35f87edadcfd_del complete
Oct 23 23:32:22 user nova-compute[74482]: INFO nova.compute.manager [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:32:22 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Took 0.42 seconds to deallocate network for instance.
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received event network-vif-unplugged-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] No waiting events found dispatching network-vif-unplugged-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:32:22 user nova-compute[74482]: WARNING nova.compute.manager [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received unexpected event network-vif-unplugged-8c8022d9-b70f-4b18-9d63-515613278b2a for instance with vm_state deleted and task_state None.
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received event network-vif-plugged-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] Acquiring lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] No waiting events found dispatching network-vif-plugged-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:32:22 user nova-compute[74482]: WARNING nova.compute.manager [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received unexpected event network-vif-plugged-8c8022d9-b70f-4b18-9d63-515613278b2a for instance with vm_state deleted and task_state None.
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-88a7c588-6e24-4496-909e-c24b41a03319 req-3e8fe616-191a-4048-bbbc-c20b54fc5933 service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received event network-vif-deleted-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:22 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Deleted allocations for instance bdd23906-9be5-4f01-822c-35f87edadcfd
Oct 23 23:32:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f3c1459-5e59-457a-9595-8a4095f8c08c tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "bdd23906-9be5-4f01-822c-35f87edadcfd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.649s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-91dd081a-9789-4be2-9a2e-c3da8a7441c6 req-01be1e61-0244-4057-b7a6-56dbc5ab6f4a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Received event network-changed-8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:32:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-91dd081a-9789-4be2-9a2e-c3da8a7441c6 req-01be1e61-0244-4057-b7a6-56dbc5ab6f4a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Refreshing instance network info cache due to event network-changed-8c8022d9-b70f-4b18-9d63-515613278b2a. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:32:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-91dd081a-9789-4be2-9a2e-c3da8a7441c6 req-01be1e61-0244-4057-b7a6-56dbc5ab6f4a service nova] Acquiring lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:32:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-91dd081a-9789-4be2-9a2e-c3da8a7441c6 req-01be1e61-0244-4057-b7a6-56dbc5ab6f4a service nova] Acquired lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:32:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-91dd081a-9789-4be2-9a2e-c3da8a7441c6 req-01be1e61-0244-4057-b7a6-56dbc5ab6f4a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Refreshing network info cache for port 8c8022d9-b70f-4b18-9d63-515613278b2a {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:32:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-91dd081a-9789-4be2-9a2e-c3da8a7441c6 req-01be1e61-0244-4057-b7a6-56dbc5ab6f4a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:32:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-91dd081a-9789-4be2-9a2e-c3da8a7441c6 req-01be1e61-0244-4057-b7a6-56dbc5ab6f4a service nova] [instance: bdd23906-9be5-4f01-822c-35f87edadcfd] Instance is deleted, no further info cache update {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Oct 23 23:32:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-91dd081a-9789-4be2-9a2e-c3da8a7441c6 req-01be1e61-0244-4057-b7a6-56dbc5ab6f4a service nova] Releasing lock "refresh_cache-bdd23906-9be5-4f01-822c-35f87edadcfd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:32:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updating instance_info_cache with network_info: [{"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-782d6230-1ba7-4b56-a77e-924ccdfd85d4" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:32:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:32:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:32:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:32:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:32:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:32:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:32:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:32:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:32:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:32:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:32:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:32:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:32:49 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:32:49 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:32:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=24.888057708740234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 193ff2db-80a1-406a-95f2-277c798fe86f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:32:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:32:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:32:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:33:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:33:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:33:10 user nova-compute[74482]: INFO nova.compute.manager [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Detaching volume 84c2d329-2f10-4463-a0e2-c789548ac6f7
Oct 23 23:33:10 user nova-compute[74482]: INFO nova.virt.block_device [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Attempting to driver detach volume 84c2d329-2f10-4463-a0e2-c789548ac6f7 from mountpoint /dev/vdb
Oct 23 23:33:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Attempting to detach device vdb from instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:33:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:33:10 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:33:10 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:33:10 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:33:10 user nova-compute[74482]:   <serial>84c2d329-2f10-4463-a0e2-c789548ac6f7</serial>
Oct 23 23:33:10 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:33:10 user nova-compute[74482]: </disk>
Oct 23 23:33:10 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:33:10 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully detached device vdb from instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 from the persistent domain config.
Oct 23 23:33:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:33:10 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:33:10 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:33:10 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:33:10 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:33:10 user nova-compute[74482]:   <serial>84c2d329-2f10-4463-a0e2-c789548ac6f7</serial>
Oct 23 23:33:10 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:33:10 user nova-compute[74482]: </disk>
Oct 23 23:33:10 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:33:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:33:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:31 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 is timed out.
Oct 23 23:33:31 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully detached device vdb from instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 from the live domain config.
Oct 23 23:33:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iYuLqcva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:33:31 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[967cbb48-6823-4aa3-946d-50a1cd2cc26c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:33:31 user nova-compute[74482]: No targets found.
Oct 23 23:33:31 user nova-compute[74482]: iSNS:
Oct 23 23:33:31 user nova-compute[74482]: No targets found.
Oct 23 23:33:31 user nova-compute[74482]: STATIC:
Oct 23 23:33:31 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7
Oct 23 23:33:31 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:33:31 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:33:31 user nova-compute[74482]: FIRMWARE:
Oct 23 23:33:31 user nova-compute[74482]: No targets found.
Oct 23 23:33:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:33:31 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:33:31 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[72064088-04d0-4b3a-a013-1cdeae8306af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccbe740-35b5-4049-9d06-073835a46e09]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:33:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 (non-flash)
Oct 23 23:33:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c442ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99345f3d-9a99-4e5d-8e1b-aaf4474ff283]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0c1015-20b7-4e46-8c25-5e8f114f808d]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e86169-a850-41ec-bc3e-745e02780b7a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ab353e-4417-4aad-926b-cd30d789fb56]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cba760-0f70-4ae3-87a9-6851c32d509b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ec73de-0daf-49f7-b7a9-978dc6bd2ab7]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7, portal: 172.16.0.220,3260]
Oct 23 23:33:31 user nova-compute[74482]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7, portal: 172.16.0.220,3260] successful.
Oct 23 23:33:31 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84c2d329-2f10-4463-a0e2-c789548ac6f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f69311c-3321-40fe-b605-efa8d838fc0a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] <== disconnect_volume: return (267ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-f7d81ef8-e23a-41c4-935c-80ce453a897e req-dd081875-f45c-4920-8f1a-3901b6550652 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received event network-changed-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-f7d81ef8-e23a-41c4-935c-80ce453a897e req-dd081875-f45c-4920-8f1a-3901b6550652 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Refreshing instance network info cache due to event network-changed-893f5969-9bdd-4417-a50e-425d262ebf33. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f7d81ef8-e23a-41c4-935c-80ce453a897e req-dd081875-f45c-4920-8f1a-3901b6550652 service nova] Acquiring lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f7d81ef8-e23a-41c4-935c-80ce453a897e req-dd081875-f45c-4920-8f1a-3901b6550652 service nova] Acquired lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG nova.network.neutron [req-f7d81ef8-e23a-41c4-935c-80ce453a897e req-dd081875-f45c-4920-8f1a-3901b6550652 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Refreshing network info cache for port 893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:33:31 user nova-compute[74482]: INFO nova.compute.manager [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Terminating instance
Oct 23 23:33:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.network.neutron [req-f7d81ef8-e23a-41c4-935c-80ce453a897e req-dd081875-f45c-4920-8f1a-3901b6550652 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updated VIF entry in instance network info cache for port 893f5969-9bdd-4417-a50e-425d262ebf33. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.network.neutron [req-f7d81ef8-e23a-41c4-935c-80ce453a897e req-dd081875-f45c-4920-8f1a-3901b6550652 service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updating instance_info_cache with network_info: [{"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f7d81ef8-e23a-41c4-935c-80ce453a897e req-dd081875-f45c-4920-8f1a-3901b6550652 service nova] Releasing lock "refresh_cache-193ff2db-80a1-406a-95f2-277c798fe86f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-1b682249-8f33-4d68-9e3b-93fc63861bb4 req-4dfcbbde-8a3f-455f-a5cf-8f9ec906c33b service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received event network-vif-unplugged-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1b682249-8f33-4d68-9e3b-93fc63861bb4 req-4dfcbbde-8a3f-455f-a5cf-8f9ec906c33b service nova] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1b682249-8f33-4d68-9e3b-93fc63861bb4 req-4dfcbbde-8a3f-455f-a5cf-8f9ec906c33b service nova] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1b682249-8f33-4d68-9e3b-93fc63861bb4 req-4dfcbbde-8a3f-455f-a5cf-8f9ec906c33b service nova] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-1b682249-8f33-4d68-9e3b-93fc63861bb4 req-4dfcbbde-8a3f-455f-a5cf-8f9ec906c33b service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] No waiting events found dispatching network-vif-unplugged-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-1b682249-8f33-4d68-9e3b-93fc63861bb4 req-4dfcbbde-8a3f-455f-a5cf-8f9ec906c33b service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received event network-vif-unplugged-893f5969-9bdd-4417-a50e-425d262ebf33 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'flavor' on Instance uuid 782d6230-1ba7-4b56-a77e-924ccdfd85d4 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1c1775d7-1654-4d89-abf8-a4a67c4fe3dd tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.873s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:33:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Instance destroyed successfully.
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.objects.instance [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lazy-loading 'resources' on Instance uuid 193ff2db-80a1-406a-95f2-277c798fe86f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:25:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-248313517',display_name='tempest-TestStampPattern-server-248313517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-248313517',id=37,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7YQZm1GfqtZoOS480LjJpdLzFfHr8ohWltRZjWaUsDY7dilvyzekzrkZYBE59rzhwwvndw38f2+LRwrE6/EhfokssEcMuybAOSKBD0XCZ5rgLApMr4Fjos3ZmCSubEKQ==',key_name='tempest-TestStampPattern-726908670',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:26:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5990acffa754d12b9bb47fc0f44f0e8',ramdisk_id='',reservation_id='r-wmjlr0ba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-5890009',owner_user_name='tempest-TestStampPattern-5890009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:29:15Z,user_data=None,user_id='03405619ccc741db816ae85847d709dc',uuid=193ff2db-80a1-406a-95f2-277c798fe86f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converting VIF {"id": "893f5969-9bdd-4417-a50e-425d262ebf33", "address": "fa:16:3e:07:68:67", "network": {"id": "4c54d4f6-97aa-47eb-8e46-020b7966f8fc", "bridge": "br-int", "label": "tempest-TestStampPattern-150435951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5990acffa754d12b9bb47fc0f44f0e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893f5969-9b", "ovs_interfaceid": "893f5969-9bdd-4417-a50e-425d262ebf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:68:67,bridge_name='br-int',has_traffic_filtering=True,id=893f5969-9bdd-4417-a50e-425d262ebf33,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893f5969-9b') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG os_vif [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:68:67,bridge_name='br-int',has_traffic_filtering=True,id=893f5969-9bdd-4417-a50e-425d262ebf33,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893f5969-9b') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap893f5969-9b, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19f20b60-c52f-40f8-a7af-39094f058826) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:33:32 user nova-compute[74482]: INFO os_vif [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:68:67,bridge_name='br-int',has_traffic_filtering=True,id=893f5969-9bdd-4417-a50e-425d262ebf33,network=Network(4c54d4f6-97aa-47eb-8e46-020b7966f8fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893f5969-9b')
Oct 23 23:33:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Deleting instance files /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f_del
Oct 23 23:33:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Deletion of /opt/stack/data/nova/instances/193ff2db-80a1-406a-95f2-277c798fe86f_del complete
Oct 23 23:33:32 user nova-compute[74482]: INFO nova.compute.manager [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 23 23:33:32 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:33:32 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:33:33 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Took 0.42 seconds to deallocate network for instance.
Oct 23 23:33:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:33:33 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Deleted allocations for instance 193ff2db-80a1-406a-95f2-277c798fe86f
Oct 23 23:33:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-974158e3-2b46-4a5c-bb3a-5fa322f1a3b3 tempest-TestStampPattern-5890009 tempest-TestStampPattern-5890009-project-member] Lock "193ff2db-80a1-406a-95f2-277c798fe86f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.606s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-6657a5f1-5027-43c5-b9c6-c2af8bc154aa req-34260729-2a16-456f-bba1-8f24eed869ef service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received event network-vif-deleted-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:33:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-8f591f3c-41e1-4210-804f-02cdd021b427 req-1452f6f6-daa2-4942-b20c-1754a75230ec service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received event network-vif-plugged-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:33:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8f591f3c-41e1-4210-804f-02cdd021b427 req-1452f6f6-daa2-4942-b20c-1754a75230ec service nova] Acquiring lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:33:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8f591f3c-41e1-4210-804f-02cdd021b427 req-1452f6f6-daa2-4942-b20c-1754a75230ec service nova] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:33:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-8f591f3c-41e1-4210-804f-02cdd021b427 req-1452f6f6-daa2-4942-b20c-1754a75230ec service nova] Lock "193ff2db-80a1-406a-95f2-277c798fe86f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:33:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-8f591f3c-41e1-4210-804f-02cdd021b427 req-1452f6f6-daa2-4942-b20c-1754a75230ec service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] No waiting events found dispatching network-vif-plugged-893f5969-9bdd-4417-a50e-425d262ebf33 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:33:34 user nova-compute[74482]: WARNING nova.compute.manager [req-8f591f3c-41e1-4210-804f-02cdd021b427 req-1452f6f6-daa2-4942-b20c-1754a75230ec service nova] [instance: 193ff2db-80a1-406a-95f2-277c798fe86f] Received unexpected event network-vif-plugged-893f5969-9bdd-4417-a50e-425d262ebf33 for instance with vm_state deleted and task_state None.
Oct 23 23:33:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:33:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:33:48 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:33:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:33:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:33:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:33:48 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:33:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:49 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:33:49 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:33:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=25.004581451416016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:33:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:33:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:33:57 user nova-compute[74482]: INFO nova.compute.manager [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Unshelving
Oct 23 23:33:57 user nova-compute[74482]: INFO nova.virt.block_device [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Booting with volume c4c37ff9-f88b-485d-b47b-8ebc506ffb08 at /dev/vdc
Oct 23 23:33:57 user nova-compute[74482]: DEBUG os_brick.utils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c11bc-952d-498a-b34b-0150dbdf5f38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9954ecdb-6e19-4316-9d09-80c46d8cf6a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aabc15-28f1-4ab7-8dd3-2d9aea465d8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11a3b27-7e60-44c3-ada7-46502c5ba311]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:33:57 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:33:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9c889c-0a06-45db-92d0-0511641f6546]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG os_brick.utils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating existing volume attachment record: 916e7f04-69e1-42e9-aad0-325bc033b5b8 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:33:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:34:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:00 user nova-compute[74482]: INFO nova.compute.manager [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Terminating instance
Oct 23 23:34:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:34:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-081c8b41-281f-43bd-b66d-27f0f665cd57 req-cb9c1290-8c60-4300-bf76-d12eb33a274d service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received event network-vif-unplugged-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-081c8b41-281f-43bd-b66d-27f0f665cd57 req-cb9c1290-8c60-4300-bf76-d12eb33a274d service nova] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-081c8b41-281f-43bd-b66d-27f0f665cd57 req-cb9c1290-8c60-4300-bf76-d12eb33a274d service nova] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-081c8b41-281f-43bd-b66d-27f0f665cd57 req-cb9c1290-8c60-4300-bf76-d12eb33a274d service nova] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-081c8b41-281f-43bd-b66d-27f0f665cd57 req-cb9c1290-8c60-4300-bf76-d12eb33a274d service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] No waiting events found dispatching network-vif-unplugged-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-081c8b41-281f-43bd-b66d-27f0f665cd57 req-cb9c1290-8c60-4300-bf76-d12eb33a274d service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received event network-vif-unplugged-3e650827-f225-43df-85f3-caf2893e4e30 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Instance destroyed successfully.
Oct 23 23:34:01 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'resources' on Instance uuid 782d6230-1ba7-4b56-a77e-924ccdfd85d4 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1804628039',display_name='tempest-AttachVolumeNegativeTest-server-1804628039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1804628039',id=38,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrmi45WlhU5yVEWLblSJGEvHGJ9C5rrftXBuuzpG8zQpggkrjSR2vpHSdiZEWOvPiqcddUmA5xoNKlqaaj6Im12S0TcwFmLHN73QbjZJzM3/IlyKb4bFWbtygEZEYaBkw==',key_name='tempest-keypair-778122097',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:28:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-txbmeber',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=782d6230-1ba7-4b56-a77e-924ccdfd85d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "3e650827-f225-43df-85f3-caf2893e4e30", "address": "fa:16:3e:d7:ae:8b", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e650827-f2", "ovs_interfaceid": "3e650827-f225-43df-85f3-caf2893e4e30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ae:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e650827-f225-43df-85f3-caf2893e4e30,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e650827-f2') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG os_vif [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ae:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e650827-f225-43df-85f3-caf2893e4e30,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e650827-f2') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e650827-f2, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05f93fcb-8770-492f-aab7-61d965b6f0b0) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:34:01 user nova-compute[74482]: INFO os_vif [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ae:8b,bridge_name='br-int',has_traffic_filtering=True,id=3e650827-f225-43df-85f3-caf2893e4e30,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e650827-f2')
Oct 23 23:34:01 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Deleting instance files /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4_del
Oct 23 23:34:01 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Deletion of /opt/stack/data/nova/instances/782d6230-1ba7-4b56-a77e-924ccdfd85d4_del complete
Oct 23 23:34:01 user nova-compute[74482]: INFO nova.compute.manager [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 23 23:34:01 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:34:01 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:34:02 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:34:02 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Took 1.03 seconds to deallocate network for instance.
Oct 23 23:34:02 user nova-compute[74482]: DEBUG nova.compute.manager [req-114be3bf-fa0b-4bb2-8a4a-97aea931691d req-deef36ef-68ff-4bd5-8132-7b454b2bda58 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received event network-vif-deleted-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:34:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:03 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:34:03 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:34:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:03 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Deleted allocations for instance 782d6230-1ba7-4b56-a77e-924ccdfd85d4
Oct 23 23:34:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d00fa664-ba46-4680-94dc-a643ffad7cf5 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.272s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-4ee60a6c-0dc8-46b6-8c57-f9504fefd50b req-633ecf06-3244-4be6-b4a5-35221966bb35 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received event network-vif-plugged-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:34:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ee60a6c-0dc8-46b6-8c57-f9504fefd50b req-633ecf06-3244-4be6-b4a5-35221966bb35 service nova] Acquiring lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ee60a6c-0dc8-46b6-8c57-f9504fefd50b req-633ecf06-3244-4be6-b4a5-35221966bb35 service nova] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ee60a6c-0dc8-46b6-8c57-f9504fefd50b req-633ecf06-3244-4be6-b4a5-35221966bb35 service nova] Lock "782d6230-1ba7-4b56-a77e-924ccdfd85d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:03 user nova-compute[74482]: DEBUG nova.compute.manager [req-4ee60a6c-0dc8-46b6-8c57-f9504fefd50b req-633ecf06-3244-4be6-b4a5-35221966bb35 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] No waiting events found dispatching network-vif-plugged-3e650827-f225-43df-85f3-caf2893e4e30 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:34:03 user nova-compute[74482]: WARNING nova.compute.manager [req-4ee60a6c-0dc8-46b6-8c57-f9504fefd50b req-633ecf06-3244-4be6-b4a5-35221966bb35 service nova] [instance: 782d6230-1ba7-4b56-a77e-924ccdfd85d4] Received unexpected event network-vif-plugged-3e650827-f225-43df-85f3-caf2893e4e30 for instance with vm_state deleted and task_state None.
Oct 23 23:34:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:34:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:34:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:34:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:34:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:13 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'pci_requests' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:34:13 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'numa_topology' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:34:13 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:34:13 user nova-compute[74482]: INFO nova.compute.claims [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Claim successful on node user
Oct 23 23:34:13 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:34:13 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:34:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:13 user nova-compute[74482]: INFO nova.network.neutron [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating port 8a005747-4659-4fda-8deb-613e576764a4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquired lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG nova.compute.manager [req-f37f5dbd-2107-450f-b0e7-9b75ee9e6bec req-315ed21f-2cf7-4724-a0cf-caf8221c3309 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-changed-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG nova.compute.manager [req-f37f5dbd-2107-450f-b0e7-9b75ee9e6bec req-315ed21f-2cf7-4724-a0cf-caf8221c3309 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Refreshing instance network info cache due to event network-changed-8a005747-4659-4fda-8deb-613e576764a4. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f37f5dbd-2107-450f-b0e7-9b75ee9e6bec req-315ed21f-2cf7-4724-a0cf-caf8221c3309 service nova] Acquiring lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Releasing lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:34:14 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Creating image(s)
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f37f5dbd-2107-450f-b0e7-9b75ee9e6bec req-315ed21f-2cf7-4724-a0cf-caf8221c3309 service nova] Acquired lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG nova.network.neutron [req-f37f5dbd-2107-450f-b0e7-9b75ee9e6bec req-315ed21f-2cf7-4724-a0cf-caf8221c3309 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Refreshing network info cache for port 8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG nova.objects.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<08a2d993-a54a-4001-a26a-cb2997b639a0> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:15 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd.part --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:15 user nova-compute[74482]: DEBUG nova.virt.images [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] 12bc0f52-c9ec-4d78-87ec-d451916acf1d was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 23:34:15 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd.part /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG nova.network.neutron [req-f37f5dbd-2107-450f-b0e7-9b75ee9e6bec req-315ed21f-2cf7-4724-a0cf-caf8221c3309 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updated VIF entry in instance network info cache for port 8a005747-4659-4fda-8deb-613e576764a4. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG nova.network.neutron [req-f37f5dbd-2107-450f-b0e7-9b75ee9e6bec req-315ed21f-2cf7-4724-a0cf-caf8221c3309 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f37f5dbd-2107-450f-b0e7-9b75ee9e6bec req-315ed21f-2cf7-4724-a0cf-caf8221c3309 service nova] Releasing lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd.part /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd.converted" returned: 0 in 0.355s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.769s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd --force-share --output=json" returned: 0 in 0.170s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd,backing_fmt=raw /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd,backing_fmt=raw /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk 1073741824" returned: 0 in 0.053s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:17 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'migration_context' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:34:17 user nova-compute[74482]: DEBUG nova.objects.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<08a2d993-a54a-4001-a26a-cb2997b639a0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:34:17 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Rebasing disk image.
Oct 23 23:34:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae -F raw /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae -F raw /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk" returned: 0 in 2.213s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Ensure instance console log exists: /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Start _get_guest_xml network_info=[{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3588f59711daf39f05e8a92e127a4401',container_format='bare',created_at=2023-10-23T23:32:05Z,direct_url=<?>,disk_format='qcow2',id=12bc0f52-c9ec-4d78-87ec-d451916acf1d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1723148553-shelved',owner='5ba7757462104f96812975fbc57a47c8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T23:32:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyxZPAtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '08a2d993-a54a-4001-a26a-cb2997b639a0', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4c37ff9-f88b-485d-b47b-8ebc506ffb08', 'serial': 'c4c37ff9-f88b-485d-b47b-8ebc506ffb08'}, 'disk_bus': 'virtio', 'attachment_id': '916e7f04-69e1-42e9-aad0-325bc033b5b8', 'boot_index': None, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:34:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:34:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3588f59711daf39f05e8a92e127a4401',container_format='bare',created_at=2023-10-23T23:32:05Z,direct_url=<?>,disk_format='qcow2',id=12bc0f52-c9ec-4d78-87ec-d451916acf1d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1723148553-shelved',owner='5ba7757462104f96812975fbc57a47c8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T23:32:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.objects.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<08a2d993-a54a-4001-a26a-cb2997b639a0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyxZPAtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:34:19 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:34:19 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:34:19 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef422a6-3613-4622-baf2-e9b0691af25b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:34:19 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01f32a7-3c82-454d-8e68-51fa2d34ff12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08] added
Oct 23 23:34:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9a73ff-1e7c-4392-b436-ff572c8ef0a3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de73c9d-2f5e-416e-9e02-7f768e4ed92e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XyxZPAtc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XyxZPAtc" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e43a18d-da62-4827-b344-da481f5a19a3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XyxZPAtc'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fa80cd-7b06-49db-b05b-b0042c53b865]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd319f-1542-42b0-abd4-94e7cb9aca06]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:34:19 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:34:19 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:34:19 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:34:19 user nova-compute[74482]: 
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebb822d-a3d4-48a9-a853-6e82f3178c6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08, portal: 172.16.0.220,3260]
Oct 23 23:34:19 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08, portal: 172.16.0.220,3260] successful.
Oct 23 23:34:19 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.095s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[949ebbf2-6b90-4e4f-a4c3-ec000297e304]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:34:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1206ebed-e2eb-449e-9a54-9b68b1633718]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 (non-flash)
Oct 23 23:34:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 (non-flash)
Oct 23 23:34:20 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.040s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fe8ec1-4de3-410c-a79b-52452d052c21]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:34:20 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyxZPAtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23934336566316361', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934336566316361', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1723148553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1723148553',id=40,image_ref='12bc0f52-c9ec-4d78-87ec-d451916acf1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1338837894',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:30:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-f8a2l7gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member',shelved_at='2023-10-23T23:32:08.728975',shelved_host='user',shelved_image_id='12bc0f52-c9ec-4d78-87ec-d451916acf1d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=08a2d993-a54a-4001-a26a-cb2997b639a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'pci_devices' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.objects.base [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<08a2d993-a54a-4001-a26a-cb2997b639a0> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:34:21 user nova-compute[74482]:   <uuid>08a2d993-a54a-4001-a26a-cb2997b639a0</uuid>
Oct 23 23:34:21 user nova-compute[74482]:   <name>instance-00000028</name>
Oct 23 23:34:21 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:34:21 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:34:21 user nova-compute[74482]:   <metadata>
Oct 23 23:34:21 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:34:21 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:34:21 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1723148553</nova:name>
Oct 23 23:34:21 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:34:19</nova:creationTime>
Oct 23 23:34:21 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:34:21 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:34:21 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:34:21 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:34:21 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:34:21 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:34:21 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:34:21 user nova-compute[74482]:       <nova:owner>
Oct 23 23:34:21 user nova-compute[74482]:         <nova:user uuid="158ff13b4023443190e1f9a4d36fb1a9">tempest-AttachVolumeShelveTestJSON-1885712928-project-member</nova:user>
Oct 23 23:34:21 user nova-compute[74482]:         <nova:project uuid="5ba7757462104f96812975fbc57a47c8">tempest-AttachVolumeShelveTestJSON-1885712928</nova:project>
Oct 23 23:34:21 user nova-compute[74482]:       </nova:owner>
Oct 23 23:34:21 user nova-compute[74482]:       <nova:root type="image" uuid="12bc0f52-c9ec-4d78-87ec-d451916acf1d"/>
Oct 23 23:34:21 user nova-compute[74482]:       <nova:ports>
Oct 23 23:34:21 user nova-compute[74482]:         <nova:port uuid="8a005747-4659-4fda-8deb-613e576764a4">
Oct 23 23:34:21 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 23:34:21 user nova-compute[74482]:         </nova:port>
Oct 23 23:34:21 user nova-compute[74482]:       </nova:ports>
Oct 23 23:34:21 user nova-compute[74482]:     </nova:instance>
Oct 23 23:34:21 user nova-compute[74482]:   </metadata>
Oct 23 23:34:21 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:34:21 user nova-compute[74482]:     <system>
Oct 23 23:34:21 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:34:21 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:34:21 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:34:21 user nova-compute[74482]:       <entry name="serial">08a2d993-a54a-4001-a26a-cb2997b639a0</entry>
Oct 23 23:34:21 user nova-compute[74482]:       <entry name="uuid">08a2d993-a54a-4001-a26a-cb2997b639a0</entry>
Oct 23 23:34:21 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:34:21 user nova-compute[74482]:     </system>
Oct 23 23:34:21 user nova-compute[74482]:   </sysinfo>
Oct 23 23:34:21 user nova-compute[74482]:   <os>
Oct 23 23:34:21 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:34:21 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:34:21 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:34:21 user nova-compute[74482]:   </os>
Oct 23 23:34:21 user nova-compute[74482]:   <features>
Oct 23 23:34:21 user nova-compute[74482]:     <acpi/>
Oct 23 23:34:21 user nova-compute[74482]:     <apic/>
Oct 23 23:34:21 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:34:21 user nova-compute[74482]:   </features>
Oct 23 23:34:21 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:34:21 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:34:21 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:34:21 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:34:21 user nova-compute[74482]:   </clock>
Oct 23 23:34:21 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:34:21 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:34:21 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:34:21 user nova-compute[74482]:   </cpu>
Oct 23 23:34:21 user nova-compute[74482]:   <devices>
Oct 23 23:34:21 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:34:21 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:34:21 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk"/>
Oct 23 23:34:21 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:34:21 user nova-compute[74482]:     </disk>
Oct 23 23:34:21 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:34:21 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:34:21 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:34:21 user nova-compute[74482]:       <target dev="vdc" bus="virtio"/>
Oct 23 23:34:21 user nova-compute[74482]:       <serial>c4c37ff9-f88b-485d-b47b-8ebc506ffb08</serial>
Oct 23 23:34:21 user nova-compute[74482]:     </disk>
Oct 23 23:34:21 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:34:21 user nova-compute[74482]:       <mac address="fa:16:3e:24:cf:87"/>
Oct 23 23:34:21 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:34:21 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:34:21 user nova-compute[74482]:       <target dev="tap8a005747-46"/>
Oct 23 23:34:21 user nova-compute[74482]:     </interface>
Oct 23 23:34:21 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:34:21 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/console.log" append="off"/>
Oct 23 23:34:21 user nova-compute[74482]:     </serial>
Oct 23 23:34:21 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:34:21 user nova-compute[74482]:     <video>
Oct 23 23:34:21 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:34:21 user nova-compute[74482]:     </video>
Oct 23 23:34:21 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:34:21 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:34:21 user nova-compute[74482]:     </rng>
Oct 23 23:34:21 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:34:21 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:34:21 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:34:21 user nova-compute[74482]:     </memballoon>
Oct 23 23:34:21 user nova-compute[74482]:   </devices>
Oct 23 23:34:21 user nova-compute[74482]: </domain>
Oct 23 23:34:21 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1723148553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1723148553',id=40,image_ref='12bc0f52-c9ec-4d78-87ec-d451916acf1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1338837894',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:30:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-f8a2l7gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member',shelved_at='2023-10-23T23:32:08.728975',shelved_host='user',shelved_image_id='12bc0f52-c9ec-4d78-87ec-d451916acf1d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=08a2d993-a54a-4001-a26a-cb2997b639a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG os_vif [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'baf68f22-17ab-508d-a2d6-d63c163a160b', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a005747-46, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a005747-46, col_values=(('qos', UUID('645b7d7f-02c8-42e3-ba32-7c55d62878b3')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a005747-46, col_values=(('external_ids', {'iface-id': '8a005747-4659-4fda-8deb-613e576764a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:cf:87', 'vm-uuid': '08a2d993-a54a-4001-a26a-cb2997b639a0'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:21 user nova-compute[74482]: INFO os_vif [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46')
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:34:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] No VIF found with MAC fa:16:3e:24:cf:87, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:34:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-d63ff0e4-107d-4d0e-8f4b-29a1ef5c85c5 req-2f6e20d6-6983-48d0-a9cd-1e06f26fe9ed service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:34:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d63ff0e4-107d-4d0e-8f4b-29a1ef5c85c5 req-2f6e20d6-6983-48d0-a9cd-1e06f26fe9ed service nova] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d63ff0e4-107d-4d0e-8f4b-29a1ef5c85c5 req-2f6e20d6-6983-48d0-a9cd-1e06f26fe9ed service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d63ff0e4-107d-4d0e-8f4b-29a1ef5c85c5 req-2f6e20d6-6983-48d0-a9cd-1e06f26fe9ed service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-d63ff0e4-107d-4d0e-8f4b-29a1ef5c85c5 req-2f6e20d6-6983-48d0-a9cd-1e06f26fe9ed service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] No waiting events found dispatching network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:34:22 user nova-compute[74482]: WARNING nova.compute.manager [req-d63ff0e4-107d-4d0e-8f4b-29a1ef5c85c5 req-2f6e20d6-6983-48d0-a9cd-1e06f26fe9ed service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received unexpected event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 23:34:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-500fb356-f4a1-43d0-a63a-56a5179c5c69 req-09005b71-16d1-46f1-8ff3-bcea7b6eba73 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:34:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-500fb356-f4a1-43d0-a63a-56a5179c5c69 req-09005b71-16d1-46f1-8ff3-bcea7b6eba73 service nova] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-500fb356-f4a1-43d0-a63a-56a5179c5c69 req-09005b71-16d1-46f1-8ff3-bcea7b6eba73 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-500fb356-f4a1-43d0-a63a-56a5179c5c69 req-09005b71-16d1-46f1-8ff3-bcea7b6eba73 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:24 user nova-compute[74482]: DEBUG nova.compute.manager [req-500fb356-f4a1-43d0-a63a-56a5179c5c69 req-09005b71-16d1-46f1-8ff3-bcea7b6eba73 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] No waiting events found dispatching network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:34:24 user nova-compute[74482]: WARNING nova.compute.manager [req-500fb356-f4a1-43d0-a63a-56a5179c5c69 req-09005b71-16d1-46f1-8ff3-bcea7b6eba73 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received unexpected event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 23:34:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:34:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:34:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance spawned successfully.
Oct 23 23:34:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:34:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f5bcd583-9fb7-4716-b551-953c1ffd7d14 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 27.815s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:34:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:34:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:34:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:34:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:34:33 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:34:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:34:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:34:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:34:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:34:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:34:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:34:50 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:34:50 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:34:50 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.005298614501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 08a2d993-a54a-4001-a26a-cb2997b639a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:34:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:34:54 user nova-compute[74482]: INFO nova.compute.claims [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Claim successful on node user
Oct 23 23:34:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.network.neutron [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:34:54 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:34:54 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Creating image(s)
Oct 23 23:34:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "/opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "/opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:54 user nova-compute[74482]: DEBUG nova.policy [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e723ee9b17d24a31b9d63246e0a6b054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f035fff650c45109cdf0779013139ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.169s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk 1073741824" returned: 0 in 0.049s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Cannot resize image /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Ensure instance console log exists: /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Successfully created port: b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Successfully updated port: b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquired lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-e8d80b20-3e74-460c-adbb-551786dd5f36 req-2bae1873-112a-4c64-a543-871c5e16a38c service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received event network-changed-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-e8d80b20-3e74-460c-adbb-551786dd5f36 req-2bae1873-112a-4c64-a543-871c5e16a38c service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Refreshing instance network info cache due to event network-changed-b4edc04c-516c-490f-b324-f3a1c2f03fec. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e8d80b20-3e74-460c-adbb-551786dd5f36 req-2bae1873-112a-4c64-a543-871c5e16a38c service nova] Acquiring lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updating instance_info_cache with network_info: [{"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Releasing lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Instance network_info: |[{"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e8d80b20-3e74-460c-adbb-551786dd5f36 req-2bae1873-112a-4c64-a543-871c5e16a38c service nova] Acquired lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.network.neutron [req-e8d80b20-3e74-460c-adbb-551786dd5f36 req-2bae1873-112a-4c64-a543-871c5e16a38c service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Refreshing network info cache for port b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Start _get_guest_xml network_info=[{"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:34:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:34:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1181776260',display_name='tempest-AttachVolumeNegativeTest-server-1181776260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1181776260',id=42,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtLY5jztAoP8cSfOyXQPdL9Slun1b7brX2J4aJXPWfrJLZQH8F1+yMyxvemQNP13TTtRzWIjyQ/ceKWiOwWvw+u5AfZta9Jcp6BbizFjX72Cw8v7FdHjIU+JheVluJe6w==',key_name='tempest-keypair-776882464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-nc9geyln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=8e364cf7-2423-4887-adc4-fb82566ffd4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:bf:f4,bridge_name='br-int',has_traffic_filtering=True,id=b4edc04c-516c-490f-b324-f3a1c2f03fec,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4edc04c-51') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.objects.instance [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e364cf7-2423-4887-adc4-fb82566ffd4f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:34:56 user nova-compute[74482]:   <uuid>8e364cf7-2423-4887-adc4-fb82566ffd4f</uuid>
Oct 23 23:34:56 user nova-compute[74482]:   <name>instance-0000002a</name>
Oct 23 23:34:56 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:34:56 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:34:56 user nova-compute[74482]:   <metadata>
Oct 23 23:34:56 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:34:56 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:34:56 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1181776260</nova:name>
Oct 23 23:34:56 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:34:56</nova:creationTime>
Oct 23 23:34:56 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:34:56 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:34:56 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:34:56 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:34:56 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:34:56 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:34:56 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:34:56 user nova-compute[74482]:       <nova:owner>
Oct 23 23:34:56 user nova-compute[74482]:         <nova:user uuid="e723ee9b17d24a31b9d63246e0a6b054">tempest-AttachVolumeNegativeTest-873141491-project-member</nova:user>
Oct 23 23:34:56 user nova-compute[74482]:         <nova:project uuid="4f035fff650c45109cdf0779013139ff">tempest-AttachVolumeNegativeTest-873141491</nova:project>
Oct 23 23:34:56 user nova-compute[74482]:       </nova:owner>
Oct 23 23:34:56 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:34:56 user nova-compute[74482]:       <nova:ports>
Oct 23 23:34:56 user nova-compute[74482]:         <nova:port uuid="b4edc04c-516c-490f-b324-f3a1c2f03fec">
Oct 23 23:34:56 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 23:34:56 user nova-compute[74482]:         </nova:port>
Oct 23 23:34:56 user nova-compute[74482]:       </nova:ports>
Oct 23 23:34:56 user nova-compute[74482]:     </nova:instance>
Oct 23 23:34:56 user nova-compute[74482]:   </metadata>
Oct 23 23:34:56 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:34:56 user nova-compute[74482]:     <system>
Oct 23 23:34:56 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:34:56 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:34:56 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:34:56 user nova-compute[74482]:       <entry name="serial">8e364cf7-2423-4887-adc4-fb82566ffd4f</entry>
Oct 23 23:34:56 user nova-compute[74482]:       <entry name="uuid">8e364cf7-2423-4887-adc4-fb82566ffd4f</entry>
Oct 23 23:34:56 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:34:56 user nova-compute[74482]:     </system>
Oct 23 23:34:56 user nova-compute[74482]:   </sysinfo>
Oct 23 23:34:56 user nova-compute[74482]:   <os>
Oct 23 23:34:56 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:34:56 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:34:56 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:34:56 user nova-compute[74482]:   </os>
Oct 23 23:34:56 user nova-compute[74482]:   <features>
Oct 23 23:34:56 user nova-compute[74482]:     <acpi/>
Oct 23 23:34:56 user nova-compute[74482]:     <apic/>
Oct 23 23:34:56 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:34:56 user nova-compute[74482]:   </features>
Oct 23 23:34:56 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:34:56 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:34:56 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:34:56 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:34:56 user nova-compute[74482]:   </clock>
Oct 23 23:34:56 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:34:56 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:34:56 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:34:56 user nova-compute[74482]:   </cpu>
Oct 23 23:34:56 user nova-compute[74482]:   <devices>
Oct 23 23:34:56 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:34:56 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:34:56 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk"/>
Oct 23 23:34:56 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:34:56 user nova-compute[74482]:     </disk>
Oct 23 23:34:56 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:34:56 user nova-compute[74482]:       <mac address="fa:16:3e:42:bf:f4"/>
Oct 23 23:34:56 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:34:56 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:34:56 user nova-compute[74482]:       <target dev="tapb4edc04c-51"/>
Oct 23 23:34:56 user nova-compute[74482]:     </interface>
Oct 23 23:34:56 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:34:56 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/console.log" append="off"/>
Oct 23 23:34:56 user nova-compute[74482]:     </serial>
Oct 23 23:34:56 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:34:56 user nova-compute[74482]:     <video>
Oct 23 23:34:56 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:34:56 user nova-compute[74482]:     </video>
Oct 23 23:34:56 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:34:56 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:34:56 user nova-compute[74482]:     </rng>
Oct 23 23:34:56 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:34:56 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:34:56 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:34:56 user nova-compute[74482]:     </memballoon>
Oct 23 23:34:56 user nova-compute[74482]:   </devices>
Oct 23 23:34:56 user nova-compute[74482]: </domain>
Oct 23 23:34:56 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1181776260',display_name='tempest-AttachVolumeNegativeTest-server-1181776260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1181776260',id=42,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtLY5jztAoP8cSfOyXQPdL9Slun1b7brX2J4aJXPWfrJLZQH8F1+yMyxvemQNP13TTtRzWIjyQ/ceKWiOwWvw+u5AfZta9Jcp6BbizFjX72Cw8v7FdHjIU+JheVluJe6w==',key_name='tempest-keypair-776882464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-nc9geyln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=8e364cf7-2423-4887-adc4-fb82566ffd4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:bf:f4,bridge_name='br-int',has_traffic_filtering=True,id=b4edc04c-516c-490f-b324-f3a1c2f03fec,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4edc04c-51') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG os_vif [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:bf:f4,bridge_name='br-int',has_traffic_filtering=True,id=b4edc04c-516c-490f-b324-f3a1c2f03fec,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4edc04c-51') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '171cf63b-56a4-5fa5-ac2b-144c7b62d072', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4edc04c-51, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4edc04c-51, col_values=(('qos', UUID('d2307258-9afe-4070-be90-8c34d80d9964')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4edc04c-51, col_values=(('external_ids', {'iface-id': 'b4edc04c-516c-490f-b324-f3a1c2f03fec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:bf:f4', 'vm-uuid': '8e364cf7-2423-4887-adc4-fb82566ffd4f'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:56 user nova-compute[74482]: INFO os_vif [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:bf:f4,bridge_name='br-int',has_traffic_filtering=True,id=b4edc04c-516c-490f-b324-f3a1c2f03fec,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4edc04c-51')
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:34:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No VIF found with MAC fa:16:3e:42:bf:f4, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-e8d80b20-3e74-460c-adbb-551786dd5f36 req-2bae1873-112a-4c64-a543-871c5e16a38c service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updated VIF entry in instance network info cache for port b4edc04c-516c-490f-b324-f3a1c2f03fec. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-e8d80b20-3e74-460c-adbb-551786dd5f36 req-2bae1873-112a-4c64-a543-871c5e16a38c service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updating instance_info_cache with network_info: [{"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e8d80b20-3e74-460c-adbb-551786dd5f36 req-2bae1873-112a-4c64-a543-871c5e16a38c service nova] Releasing lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Verify base images {{(pid=74482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Image id 8269c4ae-64d4-478e-8976-b601953bda88 yields fingerprint c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae {{(pid=74482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 23 23:34:57 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] image 8269c4ae-64d4-478e-8976-b601953bda88 at (/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae): checking
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] image 8269c4ae-64d4-478e-8976-b601953bda88 at (/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae): image is in use {{(pid=74482) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] 08a2d993-a54a-4001-a26a-cb2997b639a0 is a valid instance name {{(pid=74482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] 08a2d993-a54a-4001-a26a-cb2997b639a0 has a disk file {{(pid=74482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 08a2d993-a54a-4001-a26a-cb2997b639a0 is backed by c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae {{(pid=74482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] 8e364cf7-2423-4887-adc4-fb82566ffd4f is a valid instance name {{(pid=74482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] 8e364cf7-2423-4887-adc4-fb82566ffd4f has a disk file {{(pid=74482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 23 23:34:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 8e364cf7-2423-4887-adc4-fb82566ffd4f is backed by c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae {{(pid=74482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 23 23:34:58 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209
Oct 23 23:34:58 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74
Oct 23 23:34:58 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06
Oct 23 23:34:58 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5
Oct 23 23:34:58 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa
Oct 23 23:34:58 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050
Oct 23 23:34:58 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd
Oct 23 23:34:58 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Active base files: /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Removable base files: /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209 /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74 /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5 /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050 /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd
Oct 23 23:34:58 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba
Oct 23 23:34:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Verification complete {{(pid=74482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Verify swap images {{(pid=74482) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Verify ephemeral images {{(pid=74482) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-34117ed2-a9dd-40b7-8e61-52e7912a2f05 req-a9ff6d39-f681-49b8-821f-1858bfeff67c service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received event network-vif-plugged-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-34117ed2-a9dd-40b7-8e61-52e7912a2f05 req-a9ff6d39-f681-49b8-821f-1858bfeff67c service nova] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-34117ed2-a9dd-40b7-8e61-52e7912a2f05 req-a9ff6d39-f681-49b8-821f-1858bfeff67c service nova] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-34117ed2-a9dd-40b7-8e61-52e7912a2f05 req-a9ff6d39-f681-49b8-821f-1858bfeff67c service nova] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-34117ed2-a9dd-40b7-8e61-52e7912a2f05 req-a9ff6d39-f681-49b8-821f-1858bfeff67c service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] No waiting events found dispatching network-vif-plugged-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:34:58 user nova-compute[74482]: WARNING nova.compute.manager [req-34117ed2-a9dd-40b7-8e61-52e7912a2f05 req-a9ff6d39-f681-49b8-821f-1858bfeff67c service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received unexpected event network-vif-plugged-b4edc04c-516c-490f-b324-f3a1c2f03fec for instance with vm_state building and task_state spawning.
Oct 23 23:34:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:34:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:35:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Instance spawned successfully.
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:35:00 user nova-compute[74482]: INFO nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Took 5.69 seconds to spawn the instance on the hypervisor.
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-26baee50-4c88-4e63-9178-1cd3afbaf47d req-0916c2b2-d354-4967-9010-6b7876545749 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received event network-vif-plugged-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-26baee50-4c88-4e63-9178-1cd3afbaf47d req-0916c2b2-d354-4967-9010-6b7876545749 service nova] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-26baee50-4c88-4e63-9178-1cd3afbaf47d req-0916c2b2-d354-4967-9010-6b7876545749 service nova] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-26baee50-4c88-4e63-9178-1cd3afbaf47d req-0916c2b2-d354-4967-9010-6b7876545749 service nova] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:35:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-26baee50-4c88-4e63-9178-1cd3afbaf47d req-0916c2b2-d354-4967-9010-6b7876545749 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] No waiting events found dispatching network-vif-plugged-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:35:00 user nova-compute[74482]: WARNING nova.compute.manager [req-26baee50-4c88-4e63-9178-1cd3afbaf47d req-0916c2b2-d354-4967-9010-6b7876545749 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received unexpected event network-vif-plugged-b4edc04c-516c-490f-b324-f3a1c2f03fec for instance with vm_state building and task_state spawning.
Oct 23 23:35:00 user nova-compute[74482]: INFO nova.compute.manager [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Took 6.25 seconds to build instance.
Oct 23 23:35:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-34438aaa-4fd2-40af-b2bc-d0f5f0b3bfec tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.353s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:35:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [{"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-08a2d993-a54a-4001-a26a-cb2997b639a0" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:35:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:35:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:35:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:35:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:35:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:35:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:35:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_power_states {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 8e364cf7-2423-4887-adc4-fb82566ffd4f {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:35:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:35:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:35:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:35:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:35:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:42 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:35:43 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:43 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:35:43 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:35:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:35:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:35:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:35:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:35:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:35:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:35:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:35:47 user nova-compute[74482]: INFO nova.compute.manager [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Detaching volume c4c37ff9-f88b-485d-b47b-8ebc506ffb08
Oct 23 23:35:47 user nova-compute[74482]: INFO nova.virt.block_device [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Attempting to driver detach volume c4c37ff9-f88b-485d-b47b-8ebc506ffb08 from mountpoint /dev/vdc
Oct 23 23:35:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Attempting to detach device vdc from instance 08a2d993-a54a-4001-a26a-cb2997b639a0 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:35:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:35:47 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:35:47 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:35:47 user nova-compute[74482]:   <target dev="vdc" bus="virtio"/>
Oct 23 23:35:47 user nova-compute[74482]:   <serial>c4c37ff9-f88b-485d-b47b-8ebc506ffb08</serial>
Oct 23 23:35:47 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 23:35:47 user nova-compute[74482]: </disk>
Oct 23 23:35:47 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:35:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully detached device vdc from instance 08a2d993-a54a-4001-a26a-cb2997b639a0 from the persistent domain config.
Oct 23 23:35:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 08a2d993-a54a-4001-a26a-cb2997b639a0 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:35:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:35:47 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:35:47 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:35:47 user nova-compute[74482]:   <target dev="vdc" bus="virtio"/>
Oct 23 23:35:47 user nova-compute[74482]:   <serial>c4c37ff9-f88b-485d-b47b-8ebc506ffb08</serial>
Oct 23 23:35:47 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 23:35:47 user nova-compute[74482]: </disk>
Oct 23 23:35:47 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:35:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:35:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:35:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:35:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:35:49 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:35:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:35:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:35:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:35:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:35:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:35:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:35:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:35:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:35:50 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:35:50 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:35:50 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=24.975303649902344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:35:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:35:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 08a2d993-a54a-4001-a26a-cb2997b639a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 8e364cf7-2423-4887-adc4-fb82566ffd4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:35:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:35:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:35:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:35:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:35:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:35:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:35:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:36:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:08 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 08a2d993-a54a-4001-a26a-cb2997b639a0 is timed out.
Oct 23 23:36:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully detached device vdc from instance 08a2d993-a54a-4001-a26a-cb2997b639a0 from the live domain config.
Oct 23 23:36:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyxZPAtc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:36:08 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c91abd-aaaf-45cd-b37b-1ebb324c62f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:36:08 user nova-compute[74482]: No targets found.
Oct 23 23:36:08 user nova-compute[74482]: iSNS:
Oct 23 23:36:08 user nova-compute[74482]: No targets found.
Oct 23 23:36:08 user nova-compute[74482]: STATIC:
Oct 23 23:36:08 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08
Oct 23 23:36:08 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:36:08 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:36:08 user nova-compute[74482]: FIRMWARE:
Oct 23 23:36:08 user nova-compute[74482]: No targets found.
Oct 23 23:36:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:36:08 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:36:08 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8882f4b3-b343-4e27-8487-a626dbcca565]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28c38bd-2b99-4529-9e1b-4976a4fcd629]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 (non-flash)
Oct 23 23:36:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 (non-flash)
Oct 23 23:36:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30842c0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333dc65-dbeb-4250-99df-d12cd4b9991b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96bc9bc-a981-438a-a08b-c868943c6069]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c92743-0c9f-4868-b0b4-cc640cd6cece]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4c4da0-9e93-4c75-8080-cdf5d306c8c7]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3592993-668e-4c85-ab11-3823609a4a20]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7f7ad6-f41a-452c-9f2f-ada2b6f20b02]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08, portal: 172.16.0.220,3260]
Oct 23 23:36:08 user nova-compute[74482]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08, portal: 172.16.0.220,3260] successful.
Oct 23 23:36:08 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4c37ff9-f88b-485d-b47b-8ebc506ffb08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0b78a1-8f9c-4e93-83d7-f609585b7f06]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] <== disconnect_volume: return (325ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:36:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:36:09 user nova-compute[74482]: DEBUG nova.objects.instance [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'flavor' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:36:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-47518586-e776-4fe2-a6f4-16fa54539dca tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.787s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:36:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:36:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:36:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:36:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:36:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:36:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:36:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:36:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:36:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updating instance_info_cache with network_info: [{"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:36:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:36:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:36:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:36:35 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:36:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:36:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:36:38 user nova-compute[74482]: INFO nova.compute.manager [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Terminating instance
Oct 23 23:36:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a418f6e-9820-467d-84de-2379cd2ce7d5 req-4707be64-7c9e-44bf-863a-c09dabb5b5a0 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-unplugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a418f6e-9820-467d-84de-2379cd2ce7d5 req-4707be64-7c9e-44bf-863a-c09dabb5b5a0 service nova] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a418f6e-9820-467d-84de-2379cd2ce7d5 req-4707be64-7c9e-44bf-863a-c09dabb5b5a0 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a418f6e-9820-467d-84de-2379cd2ce7d5 req-4707be64-7c9e-44bf-863a-c09dabb5b5a0 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a418f6e-9820-467d-84de-2379cd2ce7d5 req-4707be64-7c9e-44bf-863a-c09dabb5b5a0 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] No waiting events found dispatching network-vif-unplugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a418f6e-9820-467d-84de-2379cd2ce7d5 req-4707be64-7c9e-44bf-863a-c09dabb5b5a0 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-unplugged-8a005747-4659-4fda-8deb-613e576764a4 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:36:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Instance destroyed successfully.
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.objects.instance [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'resources' on Instance uuid 08a2d993-a54a-4001-a26a-cb2997b639a0 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1723148553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1723148553',id=40,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGMkrNmuYgh+emqJ28fOaJ9AnU0YOEejFg6XrAS6jQeuSCmoBGIcfiuU+JPNCPQYAYcY3Bls0Q38wp8a9kLEAhDARfLcpDla/7289eQKE4Nq0D0fNeYg4aAcWzljSVdzQ==',key_name='tempest-keypair-1338837894',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:34:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-f8a2l7gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:34:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=08a2d993-a54a-4001-a26a-cb2997b639a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "8a005747-4659-4fda-8deb-613e576764a4", "address": "fa:16:3e:24:cf:87", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a005747-46", "ovs_interfaceid": "8a005747-4659-4fda-8deb-613e576764a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG os_vif [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a005747-46, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=645b7d7f-02c8-42e3-ba32-7c55d62878b3) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:39 user nova-compute[74482]: INFO os_vif [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:cf:87,bridge_name='br-int',has_traffic_filtering=True,id=8a005747-4659-4fda-8deb-613e576764a4,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a005747-46')
Oct 23 23:36:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Deleting instance files /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0_del
Oct 23 23:36:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Deletion of /opt/stack/data/nova/instances/08a2d993-a54a-4001-a26a-cb2997b639a0_del complete
Oct 23 23:36:39 user nova-compute[74482]: INFO nova.compute.manager [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 23:36:39 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:36:39 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Took 0.81 seconds to deallocate network for instance.
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-8b3775f2-a4f6-4e32-861b-9f720612ae48 req-11468f43-0676-4f42-8411-d7675ef61178 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-deleted-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:36:39 user nova-compute[74482]: INFO nova.compute.manager [req-8b3775f2-a4f6-4e32-861b-9f720612ae48 req-11468f43-0676-4f42-8411-d7675ef61178 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Neutron deleted interface 8a005747-4659-4fda-8deb-613e576764a4; detaching it from the instance and deleting it from the info cache
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.network.neutron [req-8b3775f2-a4f6-4e32-861b-9f720612ae48 req-11468f43-0676-4f42-8411-d7675ef61178 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:36:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-8b3775f2-a4f6-4e32-861b-9f720612ae48 req-11468f43-0676-4f42-8411-d7675ef61178 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Detach interface failed, port_id=8a005747-4659-4fda-8deb-613e576764a4, reason: Instance 08a2d993-a54a-4001-a26a-cb2997b639a0 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:36:40 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Deleted allocations for instance 08a2d993-a54a-4001-a26a-cb2997b639a0
Oct 23 23:36:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-fa10ddf6-0574-4fa6-b0a5-a05c231e9d40 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-facc05ef-0dd3-44a7-9fd9-a30330dd8412 req-5e98004c-2449-4776-9fd2-3cb335cfd165 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-facc05ef-0dd3-44a7-9fd9-a30330dd8412 req-5e98004c-2449-4776-9fd2-3cb335cfd165 service nova] Acquiring lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-facc05ef-0dd3-44a7-9fd9-a30330dd8412 req-5e98004c-2449-4776-9fd2-3cb335cfd165 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-facc05ef-0dd3-44a7-9fd9-a30330dd8412 req-5e98004c-2449-4776-9fd2-3cb335cfd165 service nova] Lock "08a2d993-a54a-4001-a26a-cb2997b639a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:36:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-facc05ef-0dd3-44a7-9fd9-a30330dd8412 req-5e98004c-2449-4776-9fd2-3cb335cfd165 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] No waiting events found dispatching network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:36:40 user nova-compute[74482]: WARNING nova.compute.manager [req-facc05ef-0dd3-44a7-9fd9-a30330dd8412 req-5e98004c-2449-4776-9fd2-3cb335cfd165 service nova] [instance: 08a2d993-a54a-4001-a26a-cb2997b639a0] Received unexpected event network-vif-plugged-8a005747-4659-4fda-8deb-613e576764a4 for instance with vm_state deleted and task_state None.
Oct 23 23:36:40 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:36:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-2123e1c7-39f7-4fbd-bb97-7433e143de3d req-3425afd3-cadd-43be-85e7-5b09637f1274 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received event network-changed-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:36:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-2123e1c7-39f7-4fbd-bb97-7433e143de3d req-3425afd3-cadd-43be-85e7-5b09637f1274 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Refreshing instance network info cache due to event network-changed-b4edc04c-516c-490f-b324-f3a1c2f03fec. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:36:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2123e1c7-39f7-4fbd-bb97-7433e143de3d req-3425afd3-cadd-43be-85e7-5b09637f1274 service nova] Acquiring lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:36:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2123e1c7-39f7-4fbd-bb97-7433e143de3d req-3425afd3-cadd-43be-85e7-5b09637f1274 service nova] Acquired lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:36:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-2123e1c7-39f7-4fbd-bb97-7433e143de3d req-3425afd3-cadd-43be-85e7-5b09637f1274 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Refreshing network info cache for port b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:36:46 user nova-compute[74482]: DEBUG nova.network.neutron [req-2123e1c7-39f7-4fbd-bb97-7433e143de3d req-3425afd3-cadd-43be-85e7-5b09637f1274 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updated VIF entry in instance network info cache for port b4edc04c-516c-490f-b324-f3a1c2f03fec. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:36:46 user nova-compute[74482]: DEBUG nova.network.neutron [req-2123e1c7-39f7-4fbd-bb97-7433e143de3d req-3425afd3-cadd-43be-85e7-5b09637f1274 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updating instance_info_cache with network_info: [{"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:36:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2123e1c7-39f7-4fbd-bb97-7433e143de3d req-3425afd3-cadd-43be-85e7-5b09637f1274 service nova] Releasing lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:36:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:36:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG nova.objects.instance [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'flavor' on Instance uuid 8e364cf7-2423-4887-adc4-fb82566ffd4f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:36:50 user nova-compute[74482]: INFO nova.compute.manager [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Attaching volume 81bc05ca-5fd0-4f4b-b8fd-785cb101414a to /dev/vdb
Oct 23 23:36:50 user nova-compute[74482]: DEBUG os_brick.utils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3896cb-9ce3-4c35-911b-5d9b984fb2af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d2da92-ec89-4128-a367-07d2d0bfd979]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d3b4e1-f978-4c51-996a-b42e1ac1d7c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[861956ab-2e47-4fc0-a56d-ce4f29ab1b26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:36:50 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:36:50 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaf6358-1c27-481b-bc48-09a3648200bf]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG os_brick.utils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:36:50 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updating existing volume attachment record: 135d1070-2c13-4d09-93ac-3d18effc0a1a {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:36:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:36:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:36:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:36:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:36:51 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:36:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:36:52 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:36:52 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:36:52 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=25.002395629882812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 8e364cf7-2423-4887-adc4-fb82566ffd4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:36:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:36:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:36:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:37:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbgMxYya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:37:06 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:37:06 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:37:06 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e2044e-ccb7-45f9-876e-8eaa34610694]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:37:06 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b375d163-8908-452e-9c4c-1a466e23e660]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a] added
Oct 23 23:37:06 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21585de5-96ee-4704-be69-31e444e10e20]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8735e501-0ce7-41fd-853e-041f3c18a8e4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbgMxYya {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbgMxYya" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccd5529-d4ad-487d-8d66-6565f34674eb]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VbgMxYya'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bf62ed-4f5e-4a84-b067-b03d57654d27]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2b8361-c811-4c55-ae84-78572f25f064]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:37:06 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:37:06 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:37:06 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:37:06 user nova-compute[74482]: 
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13b62ff-39ce-4852-9f34-6fec1cb068ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a, portal: 172.16.0.220,3260]
Oct 23 23:37:06 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a, portal: 172.16.0.220,3260] successful.
Oct 23 23:37:06 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e70406a-73ff-493e-acef-95223c0d8fa5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eb1ee7-52bd-402e-9776-b48c0d55bddb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a (non-flash)
Oct 23 23:37:06 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a (non-flash)
Oct 23 23:37:06 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1448302-af3c-4cfe-926d-f056a50e6673]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:06 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:37:07 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:37:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbgMxYya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:37:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:37:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23133633638316330', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:37:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133633638316330', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:37:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'flavor' on Instance uuid 8e364cf7-2423-4887-adc4-fb82566ffd4f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:37:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:37:07 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:37:07 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:37:07 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:37:07 user nova-compute[74482]:   <serial>81bc05ca-5fd0-4f4b-b8fd-785cb101414a</serial>
Oct 23 23:37:07 user nova-compute[74482]: </disk>
Oct 23 23:37:07 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:37:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:37:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:37:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No VIF found with MAC fa:16:3e:42:bf:f4, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:37:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-98d02ef5-e4da-4719-af7b-08dc1ce5d26c tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.787s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:09 user nova-compute[74482]: INFO nova.compute.manager [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Detaching volume 81bc05ca-5fd0-4f4b-b8fd-785cb101414a
Oct 23 23:37:09 user nova-compute[74482]: INFO nova.virt.block_device [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Attempting to driver detach volume 81bc05ca-5fd0-4f4b-b8fd-785cb101414a from mountpoint /dev/vdb
Oct 23 23:37:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Attempting to detach device vdb from instance 8e364cf7-2423-4887-adc4-fb82566ffd4f from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:37:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:37:09 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:37:09 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:37:09 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:37:09 user nova-compute[74482]:   <serial>81bc05ca-5fd0-4f4b-b8fd-785cb101414a</serial>
Oct 23 23:37:09 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:37:09 user nova-compute[74482]: </disk>
Oct 23 23:37:09 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:37:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully detached device vdb from instance 8e364cf7-2423-4887-adc4-fb82566ffd4f from the persistent domain config.
Oct 23 23:37:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e364cf7-2423-4887-adc4-fb82566ffd4f from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:37:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:37:09 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:37:09 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:37:09 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:37:09 user nova-compute[74482]:   <serial>81bc05ca-5fd0-4f4b-b8fd-785cb101414a</serial>
Oct 23 23:37:09 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:37:09 user nova-compute[74482]: </disk>
Oct 23 23:37:09 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:37:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e364cf7-2423-4887-adc4-fb82566ffd4f {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:37:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:29 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8e364cf7-2423-4887-adc4-fb82566ffd4f is timed out.
Oct 23 23:37:29 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully detached device vdb from instance 8e364cf7-2423-4887-adc4-fb82566ffd4f from the live domain config.
Oct 23 23:37:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbgMxYya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:37:29 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7ddfbf-c1c0-4a0e-8261-d34b59014e51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:37:29 user nova-compute[74482]: No targets found.
Oct 23 23:37:29 user nova-compute[74482]: iSNS:
Oct 23 23:37:29 user nova-compute[74482]: No targets found.
Oct 23 23:37:29 user nova-compute[74482]: STATIC:
Oct 23 23:37:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a
Oct 23 23:37:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:37:29 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:37:29 user nova-compute[74482]: FIRMWARE:
Oct 23 23:37:29 user nova-compute[74482]: No targets found.
Oct 23 23:37:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:37:29 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:37:29 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c41df5-a2d3-4cad-8475-caeeed46f0a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba0d2e-c737-4038-b180-c84f7b7749a3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a (non-flash)
Oct 23 23:37:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a (non-flash)
Oct 23 23:37:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c635fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78cab9c-3bb3-4c05-adbe-f856aa054878]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2976c92b-1b37-46e6-8957-e68ede16f224]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabac386-49e1-4eb4-a48c-61b8e5a0be9f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96adc88-dea2-41c6-9a72-d048e9a21d46]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1c550e-a608-4dc5-841a-34e87bc696f5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc8d3e8-c1e8-476f-ad50-bfdd19d6c45a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a, portal: 172.16.0.220,3260]
Oct 23 23:37:29 user nova-compute[74482]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a, portal: 172.16.0.220,3260] successful.
Oct 23 23:37:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81bc05ca-5fd0-4f4b-b8fd-785cb101414a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0c7961-1bc1-4221-90e9-47edfb98ca7b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] <== disconnect_volume: return (290ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:37:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:30 user nova-compute[74482]: DEBUG nova.objects.instance [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'flavor' on Instance uuid 8e364cf7-2423-4887-adc4-fb82566ffd4f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:37:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-8310c7e5-a5c1-4e0b-9b92-8803af6fd282 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.779s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:37:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:37:31 user nova-compute[74482]: INFO nova.compute.claims [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Claim successful on node user
Oct 23 23:37:31 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:37:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG nova.network.neutron [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:37:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:37:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG nova.policy [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '158ff13b4023443190e1f9a4d36fb1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba7757462104f96812975fbc57a47c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:37:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Creating image(s)
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk 1073741824" returned: 0 in 0.053s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG nova.network.neutron [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Successfully created port: 7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:37:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Cannot resize image /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Ensure instance console log exists: /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Successfully updated port: 7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquired lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-a66ee501-1fe9-404d-847e-c777b081aa5e req-05b1837c-3308-4f33-ab25-61431a3e5fbe service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-changed-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-a66ee501-1fe9-404d-847e-c777b081aa5e req-05b1837c-3308-4f33-ab25-61431a3e5fbe service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Refreshing instance network info cache due to event network-changed-7482c2bd-205e-4f9e-9991-23d94ed4d8a2. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a66ee501-1fe9-404d-847e-c777b081aa5e req-05b1837c-3308-4f33-ab25-61431a3e5fbe service nova] Acquiring lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Releasing lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance network_info: |[{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a66ee501-1fe9-404d-847e-c777b081aa5e req-05b1837c-3308-4f33-ab25-61431a3e5fbe service nova] Acquired lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.network.neutron [req-a66ee501-1fe9-404d-847e-c777b081aa5e req-05b1837c-3308-4f33-ab25-61431a3e5fbe service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Refreshing network info cache for port 7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Start _get_guest_xml network_info=[{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:37:33 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:37:33 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291592244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291592244',id=43,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVaVomZMkoNG7OjlGId6TuSTZnCEov6pv5RlvMnj8R9ch3swK+VpvkLnAYKWrDektdl8lAA6yK7fup6d3WuCBSKxSAFGFgIJb3S0P42kMajiE4GZmKWpqa6/qnI6/1jDg==',key_name='tempest-keypair-1029898015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-3j54stx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=e56a49cf-72c8-4aba-9a99-bc015f89a7a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.objects.instance [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'pci_devices' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:37:33 user nova-compute[74482]:   <uuid>e56a49cf-72c8-4aba-9a99-bc015f89a7a2</uuid>
Oct 23 23:37:33 user nova-compute[74482]:   <name>instance-0000002b</name>
Oct 23 23:37:33 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:37:33 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:37:33 user nova-compute[74482]:   <metadata>
Oct 23 23:37:33 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:37:33 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:37:33 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1291592244</nova:name>
Oct 23 23:37:33 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:37:33</nova:creationTime>
Oct 23 23:37:33 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:37:33 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:37:33 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:37:33 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:37:33 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:37:33 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:37:33 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:37:33 user nova-compute[74482]:       <nova:owner>
Oct 23 23:37:33 user nova-compute[74482]:         <nova:user uuid="158ff13b4023443190e1f9a4d36fb1a9">tempest-AttachVolumeShelveTestJSON-1885712928-project-member</nova:user>
Oct 23 23:37:33 user nova-compute[74482]:         <nova:project uuid="5ba7757462104f96812975fbc57a47c8">tempest-AttachVolumeShelveTestJSON-1885712928</nova:project>
Oct 23 23:37:33 user nova-compute[74482]:       </nova:owner>
Oct 23 23:37:33 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:37:33 user nova-compute[74482]:       <nova:ports>
Oct 23 23:37:33 user nova-compute[74482]:         <nova:port uuid="7482c2bd-205e-4f9e-9991-23d94ed4d8a2">
Oct 23 23:37:33 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 23:37:33 user nova-compute[74482]:         </nova:port>
Oct 23 23:37:33 user nova-compute[74482]:       </nova:ports>
Oct 23 23:37:33 user nova-compute[74482]:     </nova:instance>
Oct 23 23:37:33 user nova-compute[74482]:   </metadata>
Oct 23 23:37:33 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:37:33 user nova-compute[74482]:     <system>
Oct 23 23:37:33 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:37:33 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:37:33 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:37:33 user nova-compute[74482]:       <entry name="serial">e56a49cf-72c8-4aba-9a99-bc015f89a7a2</entry>
Oct 23 23:37:33 user nova-compute[74482]:       <entry name="uuid">e56a49cf-72c8-4aba-9a99-bc015f89a7a2</entry>
Oct 23 23:37:33 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:37:33 user nova-compute[74482]:     </system>
Oct 23 23:37:33 user nova-compute[74482]:   </sysinfo>
Oct 23 23:37:33 user nova-compute[74482]:   <os>
Oct 23 23:37:33 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:37:33 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:37:33 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:37:33 user nova-compute[74482]:   </os>
Oct 23 23:37:33 user nova-compute[74482]:   <features>
Oct 23 23:37:33 user nova-compute[74482]:     <acpi/>
Oct 23 23:37:33 user nova-compute[74482]:     <apic/>
Oct 23 23:37:33 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:37:33 user nova-compute[74482]:   </features>
Oct 23 23:37:33 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:37:33 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:37:33 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:37:33 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:37:33 user nova-compute[74482]:   </clock>
Oct 23 23:37:33 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:37:33 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:37:33 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:37:33 user nova-compute[74482]:   </cpu>
Oct 23 23:37:33 user nova-compute[74482]:   <devices>
Oct 23 23:37:33 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:37:33 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:37:33 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk"/>
Oct 23 23:37:33 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:37:33 user nova-compute[74482]:     </disk>
Oct 23 23:37:33 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:37:33 user nova-compute[74482]:       <mac address="fa:16:3e:04:f1:d2"/>
Oct 23 23:37:33 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:37:33 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:37:33 user nova-compute[74482]:       <target dev="tap7482c2bd-20"/>
Oct 23 23:37:33 user nova-compute[74482]:     </interface>
Oct 23 23:37:33 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:37:33 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/console.log" append="off"/>
Oct 23 23:37:33 user nova-compute[74482]:     </serial>
Oct 23 23:37:33 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:37:33 user nova-compute[74482]:     <video>
Oct 23 23:37:33 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:37:33 user nova-compute[74482]:     </video>
Oct 23 23:37:33 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:37:33 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:37:33 user nova-compute[74482]:     </rng>
Oct 23 23:37:33 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:37:33 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:37:33 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:37:33 user nova-compute[74482]:     </memballoon>
Oct 23 23:37:33 user nova-compute[74482]:   </devices>
Oct 23 23:37:33 user nova-compute[74482]: </domain>
Oct 23 23:37:33 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291592244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291592244',id=43,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVaVomZMkoNG7OjlGId6TuSTZnCEov6pv5RlvMnj8R9ch3swK+VpvkLnAYKWrDektdl8lAA6yK7fup6d3WuCBSKxSAFGFgIJb3S0P42kMajiE4GZmKWpqa6/qnI6/1jDg==',key_name='tempest-keypair-1029898015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-3j54stx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=e56a49cf-72c8-4aba-9a99-bc015f89a7a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG os_vif [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a444e493-1d19-5026-9e26-3ce5a78602fd', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7482c2bd-20, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7482c2bd-20, col_values=(('qos', UUID('58205249-1d06-48dc-be4e-5d623ca82117')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7482c2bd-20, col_values=(('external_ids', {'iface-id': '7482c2bd-205e-4f9e-9991-23d94ed4d8a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f1:d2', 'vm-uuid': 'e56a49cf-72c8-4aba-9a99-bc015f89a7a2'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:33 user nova-compute[74482]: INFO os_vif [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20')
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:37:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] No VIF found with MAC fa:16:3e:04:f1:d2, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG nova.network.neutron [req-a66ee501-1fe9-404d-847e-c777b081aa5e req-05b1837c-3308-4f33-ab25-61431a3e5fbe service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updated VIF entry in instance network info cache for port 7482c2bd-205e-4f9e-9991-23d94ed4d8a2. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG nova.network.neutron [req-a66ee501-1fe9-404d-847e-c777b081aa5e req-05b1837c-3308-4f33-ab25-61431a3e5fbe service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a66ee501-1fe9-404d-847e-c777b081aa5e req-05b1837c-3308-4f33-ab25-61431a3e5fbe service nova] Releasing lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Skipping network cache update for instance because it is Building. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:37:34 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 8e364cf7-2423-4887-adc4-fb82566ffd4f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updating instance_info_cache with network_info: [{"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-8e364cf7-2423-4887-adc4-fb82566ffd4f" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG nova.compute.manager [req-3a5639c5-db92-4142-878d-eadb812ca795 req-37ddabbd-e1a5-4d9a-8586-96c34e570747 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3a5639c5-db92-4142-878d-eadb812ca795 req-37ddabbd-e1a5-4d9a-8586-96c34e570747 service nova] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3a5639c5-db92-4142-878d-eadb812ca795 req-37ddabbd-e1a5-4d9a-8586-96c34e570747 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3a5639c5-db92-4142-878d-eadb812ca795 req-37ddabbd-e1a5-4d9a-8586-96c34e570747 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG nova.compute.manager [req-3a5639c5-db92-4142-878d-eadb812ca795 req-37ddabbd-e1a5-4d9a-8586-96c34e570747 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] No waiting events found dispatching network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:37:35 user nova-compute[74482]: WARNING nova.compute.manager [req-3a5639c5-db92-4142-878d-eadb812ca795 req-37ddabbd-e1a5-4d9a-8586-96c34e570747 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received unexpected event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 for instance with vm_state building and task_state spawning.
Oct 23 23:37:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:37:37 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance spawned successfully.
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:37:37 user nova-compute[74482]: INFO nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Took 5.25 seconds to spawn the instance on the hypervisor.
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.compute.manager [req-d14a5d1a-6979-47e7-a242-f81d6d0d27ef req-ffe50ffb-1381-4e79-960f-f96438c2ce4e service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d14a5d1a-6979-47e7-a242-f81d6d0d27ef req-ffe50ffb-1381-4e79-960f-f96438c2ce4e service nova] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d14a5d1a-6979-47e7-a242-f81d6d0d27ef req-ffe50ffb-1381-4e79-960f-f96438c2ce4e service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d14a5d1a-6979-47e7-a242-f81d6d0d27ef req-ffe50ffb-1381-4e79-960f-f96438c2ce4e service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.compute.manager [req-d14a5d1a-6979-47e7-a242-f81d6d0d27ef req-ffe50ffb-1381-4e79-960f-f96438c2ce4e service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] No waiting events found dispatching network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:37:37 user nova-compute[74482]: WARNING nova.compute.manager [req-d14a5d1a-6979-47e7-a242-f81d6d0d27ef req-ffe50ffb-1381-4e79-960f-f96438c2ce4e service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received unexpected event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 for instance with vm_state building and task_state spawning.
Oct 23 23:37:37 user nova-compute[74482]: INFO nova.compute.manager [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Took 5.80 seconds to build instance.
Oct 23 23:37:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-78f7900f-94ca-4fe0-a272-df078d823544 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.897s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:37:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:40 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:37:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:37:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:52 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:37:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:53 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:37:53 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:37:53 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=24.966278076171875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 8e364cf7-2423-4887-adc4-fb82566ffd4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:37:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e56a49cf-72c8-4aba-9a99-bc015f89a7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:37:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:37:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:37:54 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:37:54 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:37:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:37:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:59 user nova-compute[74482]: INFO nova.compute.manager [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Terminating instance
Oct 23 23:37:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-250f4a06-52ea-4b44-80a7-b0d103e053ca req-9d73b300-792c-4723-a635-8882b12865e3 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received event network-vif-unplugged-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-250f4a06-52ea-4b44-80a7-b0d103e053ca req-9d73b300-792c-4723-a635-8882b12865e3 service nova] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-250f4a06-52ea-4b44-80a7-b0d103e053ca req-9d73b300-792c-4723-a635-8882b12865e3 service nova] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-250f4a06-52ea-4b44-80a7-b0d103e053ca req-9d73b300-792c-4723-a635-8882b12865e3 service nova] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-250f4a06-52ea-4b44-80a7-b0d103e053ca req-9d73b300-792c-4723-a635-8882b12865e3 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] No waiting events found dispatching network-vif-unplugged-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-250f4a06-52ea-4b44-80a7-b0d103e053ca req-9d73b300-792c-4723-a635-8882b12865e3 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received event network-vif-unplugged-b4edc04c-516c-490f-b324-f3a1c2f03fec for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:37:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Instance destroyed successfully.
Oct 23 23:38:00 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'resources' on Instance uuid 8e364cf7-2423-4887-adc4-fb82566ffd4f {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1181776260',display_name='tempest-AttachVolumeNegativeTest-server-1181776260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1181776260',id=42,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtLY5jztAoP8cSfOyXQPdL9Slun1b7brX2J4aJXPWfrJLZQH8F1+yMyxvemQNP13TTtRzWIjyQ/ceKWiOwWvw+u5AfZta9Jcp6BbizFjX72Cw8v7FdHjIU+JheVluJe6w==',key_name='tempest-keypair-776882464',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:35:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-nc9geyln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:35:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=8e364cf7-2423-4887-adc4-fb82566ffd4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "address": "fa:16:3e:42:bf:f4", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4edc04c-51", "ovs_interfaceid": "b4edc04c-516c-490f-b324-f3a1c2f03fec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:bf:f4,bridge_name='br-int',has_traffic_filtering=True,id=b4edc04c-516c-490f-b324-f3a1c2f03fec,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4edc04c-51') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG os_vif [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:bf:f4,bridge_name='br-int',has_traffic_filtering=True,id=b4edc04c-516c-490f-b324-f3a1c2f03fec,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4edc04c-51') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4edc04c-51, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2307258-9afe-4070-be90-8c34d80d9964) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:38:00 user nova-compute[74482]: INFO os_vif [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:bf:f4,bridge_name='br-int',has_traffic_filtering=True,id=b4edc04c-516c-490f-b324-f3a1c2f03fec,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4edc04c-51')
Oct 23 23:38:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Deleting instance files /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f_del
Oct 23 23:38:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Deletion of /opt/stack/data/nova/instances/8e364cf7-2423-4887-adc4-fb82566ffd4f_del complete
Oct 23 23:38:00 user nova-compute[74482]: INFO nova.compute.manager [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 23:38:00 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:38:00 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Took 0.68 seconds to deallocate network for instance.
Oct 23 23:38:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:01 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:38:01 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:38:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:01 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Deleted allocations for instance 8e364cf7-2423-4887-adc4-fb82566ffd4f
Oct 23 23:38:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4323adf5-5763-4f89-a3f8-c08910ac79d8 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.871s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-fb06f41c-92f2-4d32-ab29-044e6602b164 req-aca023ce-dfef-4d34-bddb-5c8c099adb93 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received event network-vif-plugged-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:38:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fb06f41c-92f2-4d32-ab29-044e6602b164 req-aca023ce-dfef-4d34-bddb-5c8c099adb93 service nova] Acquiring lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fb06f41c-92f2-4d32-ab29-044e6602b164 req-aca023ce-dfef-4d34-bddb-5c8c099adb93 service nova] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fb06f41c-92f2-4d32-ab29-044e6602b164 req-aca023ce-dfef-4d34-bddb-5c8c099adb93 service nova] Lock "8e364cf7-2423-4887-adc4-fb82566ffd4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-fb06f41c-92f2-4d32-ab29-044e6602b164 req-aca023ce-dfef-4d34-bddb-5c8c099adb93 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] No waiting events found dispatching network-vif-plugged-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:38:01 user nova-compute[74482]: WARNING nova.compute.manager [req-fb06f41c-92f2-4d32-ab29-044e6602b164 req-aca023ce-dfef-4d34-bddb-5c8c099adb93 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received unexpected event network-vif-plugged-b4edc04c-516c-490f-b324-f3a1c2f03fec for instance with vm_state deleted and task_state None.
Oct 23 23:38:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-fb06f41c-92f2-4d32-ab29-044e6602b164 req-aca023ce-dfef-4d34-bddb-5c8c099adb93 service nova] [instance: 8e364cf7-2423-4887-adc4-fb82566ffd4f] Received event network-vif-deleted-b4edc04c-516c-490f-b324-f3a1c2f03fec {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:38:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:38:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:38:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:38:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:38:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:38:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:38:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:38:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:38:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:38:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:38:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:38:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:38:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:52 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:38:52 user nova-compute[74482]: INFO nova.compute.claims [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Claim successful on node user
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:38:53 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.policy [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e723ee9b17d24a31b9d63246e0a6b054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f035fff650c45109cdf0779013139ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:38:53 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Creating image(s)
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "/opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "/opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "/opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk 1073741824" returned: 0 in 0.053s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Successfully created port: 2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:38:53 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Cannot resize image /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Ensure instance console log exists: /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Successfully updated port: 2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-98fe4128-94c0-442b-9c30-8871d7856826 req-ef20d57a-87a7-4075-b1f4-1ecf878d6f09 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-changed-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.compute.manager [req-98fe4128-94c0-442b-9c30-8871d7856826 req-ef20d57a-87a7-4075-b1f4-1ecf878d6f09 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Refreshing instance network info cache due to event network-changed-2091ba8c-9169-470d-8796-83b024957634. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-98fe4128-94c0-442b-9c30-8871d7856826 req-ef20d57a-87a7-4075-b1f4-1ecf878d6f09 service nova] Acquiring lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-98fe4128-94c0-442b-9c30-8871d7856826 req-ef20d57a-87a7-4075-b1f4-1ecf878d6f09 service nova] Acquired lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.network.neutron [req-98fe4128-94c0-442b-9c30-8871d7856826 req-ef20d57a-87a7-4075-b1f4-1ecf878d6f09 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Refreshing network info cache for port 2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:38:54 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:38:54 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8904MB free_disk=24.991371154785156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.network.neutron [req-98fe4128-94c0-442b-9c30-8871d7856826 req-ef20d57a-87a7-4075-b1f4-1ecf878d6f09 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e56a49cf-72c8-4aba-9a99-bc015f89a7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:38:54 user nova-compute[74482]: DEBUG nova.network.neutron [req-98fe4128-94c0-442b-9c30-8871d7856826 req-ef20d57a-87a7-4075-b1f4-1ecf878d6f09 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-98fe4128-94c0-442b-9c30-8871d7856826 req-ef20d57a-87a7-4075-b1f4-1ecf878d6f09 service nova] Releasing lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquired lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updating instance_info_cache with network_info: [{"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Releasing lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Instance network_info: |[{"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Start _get_guest_xml network_info=[{"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:38:55 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:38:55 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-198127378',display_name='tempest-AttachVolumeNegativeTest-server-198127378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-198127378',id=44,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs3xwPJFDNbMq3i5a/YBMcdU8gZ/vHZksDdIzo5b4b4y9rBWLGTI3FwkDSnHZYSB0BDegKqfOa89jmmwCw50I4QJJTUM0e0BedblwGBe+xy5QPyVM8lyOePGFWdxHKNCg==',key_name='tempest-keypair-259559258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-kkk09eil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=837f647d-b7d5-40fa-bbcb-a5748786ed90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a0:6f,bridge_name='br-int',has_traffic_filtering=True,id=2091ba8c-9169-470d-8796-83b024957634,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2091ba8c-91') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'pci_devices' on Instance uuid 837f647d-b7d5-40fa-bbcb-a5748786ed90 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:38:55 user nova-compute[74482]:   <uuid>837f647d-b7d5-40fa-bbcb-a5748786ed90</uuid>
Oct 23 23:38:55 user nova-compute[74482]:   <name>instance-0000002c</name>
Oct 23 23:38:55 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:38:55 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:38:55 user nova-compute[74482]:   <metadata>
Oct 23 23:38:55 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:38:55 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:38:55 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeNegativeTest-server-198127378</nova:name>
Oct 23 23:38:55 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:38:55</nova:creationTime>
Oct 23 23:38:55 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:38:55 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:38:55 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:38:55 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:38:55 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:38:55 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:38:55 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:38:55 user nova-compute[74482]:       <nova:owner>
Oct 23 23:38:55 user nova-compute[74482]:         <nova:user uuid="e723ee9b17d24a31b9d63246e0a6b054">tempest-AttachVolumeNegativeTest-873141491-project-member</nova:user>
Oct 23 23:38:55 user nova-compute[74482]:         <nova:project uuid="4f035fff650c45109cdf0779013139ff">tempest-AttachVolumeNegativeTest-873141491</nova:project>
Oct 23 23:38:55 user nova-compute[74482]:       </nova:owner>
Oct 23 23:38:55 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:38:55 user nova-compute[74482]:       <nova:ports>
Oct 23 23:38:55 user nova-compute[74482]:         <nova:port uuid="2091ba8c-9169-470d-8796-83b024957634">
Oct 23 23:38:55 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 23:38:55 user nova-compute[74482]:         </nova:port>
Oct 23 23:38:55 user nova-compute[74482]:       </nova:ports>
Oct 23 23:38:55 user nova-compute[74482]:     </nova:instance>
Oct 23 23:38:55 user nova-compute[74482]:   </metadata>
Oct 23 23:38:55 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:38:55 user nova-compute[74482]:     <system>
Oct 23 23:38:55 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:38:55 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:38:55 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:38:55 user nova-compute[74482]:       <entry name="serial">837f647d-b7d5-40fa-bbcb-a5748786ed90</entry>
Oct 23 23:38:55 user nova-compute[74482]:       <entry name="uuid">837f647d-b7d5-40fa-bbcb-a5748786ed90</entry>
Oct 23 23:38:55 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:38:55 user nova-compute[74482]:     </system>
Oct 23 23:38:55 user nova-compute[74482]:   </sysinfo>
Oct 23 23:38:55 user nova-compute[74482]:   <os>
Oct 23 23:38:55 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:38:55 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:38:55 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:38:55 user nova-compute[74482]:   </os>
Oct 23 23:38:55 user nova-compute[74482]:   <features>
Oct 23 23:38:55 user nova-compute[74482]:     <acpi/>
Oct 23 23:38:55 user nova-compute[74482]:     <apic/>
Oct 23 23:38:55 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:38:55 user nova-compute[74482]:   </features>
Oct 23 23:38:55 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:38:55 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:38:55 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:38:55 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:38:55 user nova-compute[74482]:   </clock>
Oct 23 23:38:55 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:38:55 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:38:55 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:38:55 user nova-compute[74482]:   </cpu>
Oct 23 23:38:55 user nova-compute[74482]:   <devices>
Oct 23 23:38:55 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:38:55 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:38:55 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk"/>
Oct 23 23:38:55 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:38:55 user nova-compute[74482]:     </disk>
Oct 23 23:38:55 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:38:55 user nova-compute[74482]:       <mac address="fa:16:3e:f3:a0:6f"/>
Oct 23 23:38:55 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:38:55 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:38:55 user nova-compute[74482]:       <target dev="tap2091ba8c-91"/>
Oct 23 23:38:55 user nova-compute[74482]:     </interface>
Oct 23 23:38:55 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:38:55 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/console.log" append="off"/>
Oct 23 23:38:55 user nova-compute[74482]:     </serial>
Oct 23 23:38:55 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:38:55 user nova-compute[74482]:     <video>
Oct 23 23:38:55 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:38:55 user nova-compute[74482]:     </video>
Oct 23 23:38:55 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:38:55 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:38:55 user nova-compute[74482]:     </rng>
Oct 23 23:38:55 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:38:55 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:38:55 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:38:55 user nova-compute[74482]:     </memballoon>
Oct 23 23:38:55 user nova-compute[74482]:   </devices>
Oct 23 23:38:55 user nova-compute[74482]: </domain>
Oct 23 23:38:55 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-198127378',display_name='tempest-AttachVolumeNegativeTest-server-198127378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-198127378',id=44,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs3xwPJFDNbMq3i5a/YBMcdU8gZ/vHZksDdIzo5b4b4y9rBWLGTI3FwkDSnHZYSB0BDegKqfOa89jmmwCw50I4QJJTUM0e0BedblwGBe+xy5QPyVM8lyOePGFWdxHKNCg==',key_name='tempest-keypair-259559258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-kkk09eil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=837f647d-b7d5-40fa-bbcb-a5748786ed90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a0:6f,bridge_name='br-int',has_traffic_filtering=True,id=2091ba8c-9169-470d-8796-83b024957634,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2091ba8c-91') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG os_vif [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a0:6f,bridge_name='br-int',has_traffic_filtering=True,id=2091ba8c-9169-470d-8796-83b024957634,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2091ba8c-91') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f3e3f54-1d2d-5a4f-9f68-a7339a651d0f', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2091ba8c-91, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2091ba8c-91, col_values=(('qos', UUID('8a07b268-d4e3-4333-846f-d52c239c48a9')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2091ba8c-91, col_values=(('external_ids', {'iface-id': '2091ba8c-9169-470d-8796-83b024957634', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:a0:6f', 'vm-uuid': '837f647d-b7d5-40fa-bbcb-a5748786ed90'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:55 user nova-compute[74482]: INFO os_vif [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a0:6f,bridge_name='br-int',has_traffic_filtering=True,id=2091ba8c-9169-470d-8796-83b024957634,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2091ba8c-91')
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:38:55 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No VIF found with MAC fa:16:3e:f3:a0:6f, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:38:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-b5503f5d-448d-4cda-89b8-02def21d9827 req-1178f295-3cb6-43ce-ab49-154964c6c2ad service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:38:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b5503f5d-448d-4cda-89b8-02def21d9827 req-1178f295-3cb6-43ce-ab49-154964c6c2ad service nova] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b5503f5d-448d-4cda-89b8-02def21d9827 req-1178f295-3cb6-43ce-ab49-154964c6c2ad service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b5503f5d-448d-4cda-89b8-02def21d9827 req-1178f295-3cb6-43ce-ab49-154964c6c2ad service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-b5503f5d-448d-4cda-89b8-02def21d9827 req-1178f295-3cb6-43ce-ab49-154964c6c2ad service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] No waiting events found dispatching network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:38:56 user nova-compute[74482]: WARNING nova.compute.manager [req-b5503f5d-448d-4cda-89b8-02def21d9827 req-1178f295-3cb6-43ce-ab49-154964c6c2ad service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received unexpected event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 for instance with vm_state building and task_state spawning.
Oct 23 23:38:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:38:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:38:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:38:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Instance spawned successfully.
Oct 23 23:38:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:38:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:38:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:38:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:38:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:38:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:38:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:38:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-0cc275bc-16ed-4410-b877-54372d43979b req-39eae07c-c50d-46be-a996-3b70c9af9dca service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:38:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0cc275bc-16ed-4410-b877-54372d43979b req-39eae07c-c50d-46be-a996-3b70c9af9dca service nova] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:38:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0cc275bc-16ed-4410-b877-54372d43979b req-39eae07c-c50d-46be-a996-3b70c9af9dca service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:38:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0cc275bc-16ed-4410-b877-54372d43979b req-39eae07c-c50d-46be-a996-3b70c9af9dca service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-0cc275bc-16ed-4410-b877-54372d43979b req-39eae07c-c50d-46be-a996-3b70c9af9dca service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] No waiting events found dispatching network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:38:59 user nova-compute[74482]: WARNING nova.compute.manager [req-0cc275bc-16ed-4410-b877-54372d43979b req-39eae07c-c50d-46be-a996-3b70c9af9dca service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received unexpected event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 for instance with vm_state building and task_state spawning.
Oct 23 23:38:59 user nova-compute[74482]: INFO nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Took 5.66 seconds to spawn the instance on the hypervisor.
Oct 23 23:38:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:38:59 user nova-compute[74482]: INFO nova.compute.manager [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Took 6.24 seconds to build instance.
Oct 23 23:38:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ad153ccd-24a5-4625-b671-2355b9a14c71 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.353s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:38:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-83930012-e2fa-49d1-8fed-e7a378633f18 req-6e0fe4db-afac-4de7-abca-0a0662428351 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-changed-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:39:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-83930012-e2fa-49d1-8fed-e7a378633f18 req-6e0fe4db-afac-4de7-abca-0a0662428351 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Refreshing instance network info cache due to event network-changed-7482c2bd-205e-4f9e-9991-23d94ed4d8a2. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:39:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83930012-e2fa-49d1-8fed-e7a378633f18 req-6e0fe4db-afac-4de7-abca-0a0662428351 service nova] Acquiring lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:39:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83930012-e2fa-49d1-8fed-e7a378633f18 req-6e0fe4db-afac-4de7-abca-0a0662428351 service nova] Acquired lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:39:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-83930012-e2fa-49d1-8fed-e7a378633f18 req-6e0fe4db-afac-4de7-abca-0a0662428351 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Refreshing network info cache for port 7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:39:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-83930012-e2fa-49d1-8fed-e7a378633f18 req-6e0fe4db-afac-4de7-abca-0a0662428351 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updated VIF entry in instance network info cache for port 7482c2bd-205e-4f9e-9991-23d94ed4d8a2. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:39:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-83930012-e2fa-49d1-8fed-e7a378633f18 req-6e0fe4db-afac-4de7-abca-0a0662428351 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:39:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-83930012-e2fa-49d1-8fed-e7a378633f18 req-6e0fe4db-afac-4de7-abca-0a0662428351 service nova] Releasing lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:39:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:39:28 user nova-compute[74482]: INFO nova.compute.manager [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Shelving
Oct 23 23:39:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-1e564047-42ad-487b-ad05-fdbc8ef7ccfe req-94c21977-89f1-4fcc-8a43-22d481a482a7 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-unplugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1e564047-42ad-487b-ad05-fdbc8ef7ccfe req-94c21977-89f1-4fcc-8a43-22d481a482a7 service nova] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1e564047-42ad-487b-ad05-fdbc8ef7ccfe req-94c21977-89f1-4fcc-8a43-22d481a482a7 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1e564047-42ad-487b-ad05-fdbc8ef7ccfe req-94c21977-89f1-4fcc-8a43-22d481a482a7 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG nova.compute.manager [req-1e564047-42ad-487b-ad05-fdbc8ef7ccfe req-94c21977-89f1-4fcc-8a43-22d481a482a7 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] No waiting events found dispatching network-vif-unplugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:39:28 user nova-compute[74482]: WARNING nova.compute.manager [req-1e564047-42ad-487b-ad05-fdbc8ef7ccfe req-94c21977-89f1-4fcc-8a43-22d481a482a7 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received unexpected event network-vif-unplugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 for instance with vm_state active and task_state shelving.
Oct 23 23:39:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance destroyed successfully.
Oct 23 23:39:29 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Beginning cold snapshot process
Oct 23 23:39:29 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk /opt/stack/data/nova/instances/snapshots/tmp1qgwmwgi/ab79cfa119ec4e53aa939f0dae5f3422 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk /opt/stack/data/nova/instances/snapshots/tmp1qgwmwgi/ab79cfa119ec4e53aa939f0dae5f3422" returned: 0 in 0.468s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:39:29 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Snapshot extracted, beginning image upload
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-a6962a02-96da-4a07-8753-f5a8c9604232 req-57aa481e-2ce8-4795-a35d-fa53d976765d service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:39:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a6962a02-96da-4a07-8753-f5a8c9604232 req-57aa481e-2ce8-4795-a35d-fa53d976765d service nova] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:39:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a6962a02-96da-4a07-8753-f5a8c9604232 req-57aa481e-2ce8-4795-a35d-fa53d976765d service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:39:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a6962a02-96da-4a07-8753-f5a8c9604232 req-57aa481e-2ce8-4795-a35d-fa53d976765d service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:39:30 user nova-compute[74482]: DEBUG nova.compute.manager [req-a6962a02-96da-4a07-8753-f5a8c9604232 req-57aa481e-2ce8-4795-a35d-fa53d976765d service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] No waiting events found dispatching network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:39:30 user nova-compute[74482]: WARNING nova.compute.manager [req-a6962a02-96da-4a07-8753-f5a8c9604232 req-57aa481e-2ce8-4795-a35d-fa53d976765d service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received unexpected event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 for instance with vm_state active and task_state shelving_image_uploading.
Oct 23 23:39:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Snapshot image upload complete
Oct 23 23:39:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:39:32 user nova-compute[74482]: INFO nova.compute.manager [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Shelve offloading
Oct 23 23:39:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance destroyed successfully.
Oct 23 23:39:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:39:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:39:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquired lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:39:32 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:39:32 user nova-compute[74482]: DEBUG nova.network.neutron [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:39:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Releasing lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance destroyed successfully.
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.objects.instance [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'resources' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291592244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291592244',id=43,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVaVomZMkoNG7OjlGId6TuSTZnCEov6pv5RlvMnj8R9ch3swK+VpvkLnAYKWrDektdl8lAA6yK7fup6d3WuCBSKxSAFGFgIJb3S0P42kMajiE4GZmKWpqa6/qnI6/1jDg==',key_name='tempest-keypair-1029898015',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-3j54stx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member',shelved_at='2023-10-23T23:39:32.198593',shelved_host='user',shelved_image_id='b7a4376c-534c-45b8-a1ed-bd11c95eb918'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=e56a49cf-72c8-4aba-9a99-bc015f89a7a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG os_vif [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7482c2bd-20, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-e9314ee6-9ca6-43c2-baac-babb4c716691 req-5304537d-d51b-40ce-867a-acfde6e5819a service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-changed-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-e9314ee6-9ca6-43c2-baac-babb4c716691 req-5304537d-d51b-40ce-867a-acfde6e5819a service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Refreshing instance network info cache due to event network-changed-7482c2bd-205e-4f9e-9991-23d94ed4d8a2. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e9314ee6-9ca6-43c2-baac-babb4c716691 req-5304537d-d51b-40ce-867a-acfde6e5819a service nova] Acquiring lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e9314ee6-9ca6-43c2-baac-babb4c716691 req-5304537d-d51b-40ce-867a-acfde6e5819a service nova] Acquired lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.network.neutron [req-e9314ee6-9ca6-43c2-baac-babb4c716691 req-5304537d-d51b-40ce-867a-acfde6e5819a service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Refreshing network info cache for port 7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58205249-1d06-48dc-be4e-5d623ca82117) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:39:33 user nova-compute[74482]: INFO os_vif [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20')
Oct 23 23:39:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Deleting instance files /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2_del
Oct 23 23:39:33 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Deletion of /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2_del complete
Oct 23 23:39:33 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Deleted allocations for instance e56a49cf-72c8-4aba-9a99-bc015f89a7a2
Oct 23 23:39:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.objects.instance [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'numa_topology' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.objects.base [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<e56a49cf-72c8-4aba-9a99-bc015f89a7a2> lazy-loaded attributes: resources,numa_topology {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-b1a84f55-d831-4780-94d9-71882799f9c4 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.201s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.network.neutron [req-e9314ee6-9ca6-43c2-baac-babb4c716691 req-5304537d-d51b-40ce-867a-acfde6e5819a service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updated VIF entry in instance network info cache for port 7482c2bd-205e-4f9e-9991-23d94ed4d8a2. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG nova.network.neutron [req-e9314ee6-9ca6-43c2-baac-babb4c716691 req-5304537d-d51b-40ce-867a-acfde6e5819a service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7482c2bd-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:39:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e9314ee6-9ca6-43c2-baac-babb4c716691 req-5304537d-d51b-40ce-867a-acfde6e5819a service nova] Releasing lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 837f647d-b7d5-40fa-bbcb-a5748786ed90 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updating instance_info_cache with network_info: [{"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:39:40 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:39:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:39:54 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:39:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:39:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:39:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:39:54 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:39:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:39:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:39:54 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:39:55 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:39:55 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:39:55 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=24.940696716308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:39:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:39:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:40:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:40:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:40:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:40:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:40:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:40:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:40:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:40:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:40:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:40:39 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:40:39 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 837f647d-b7d5-40fa-bbcb-a5748786ed90 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:40:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updating instance_info_cache with network_info: [{"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:40:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:40:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:40:40 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:40:40 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:40:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:40:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:40:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:40:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-970388f0-55bc-4b99-8b11-f722143fdb3c req-ba819a92-b43f-4b31-9a54-5aba4ccc0e93 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-changed-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG nova.compute.manager [req-970388f0-55bc-4b99-8b11-f722143fdb3c req-ba819a92-b43f-4b31-9a54-5aba4ccc0e93 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Refreshing instance network info cache due to event network-changed-2091ba8c-9169-470d-8796-83b024957634. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-970388f0-55bc-4b99-8b11-f722143fdb3c req-ba819a92-b43f-4b31-9a54-5aba4ccc0e93 service nova] Acquiring lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-970388f0-55bc-4b99-8b11-f722143fdb3c req-ba819a92-b43f-4b31-9a54-5aba4ccc0e93 service nova] Acquired lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG nova.network.neutron [req-970388f0-55bc-4b99-8b11-f722143fdb3c req-ba819a92-b43f-4b31-9a54-5aba4ccc0e93 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Refreshing network info cache for port 2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG nova.network.neutron [req-970388f0-55bc-4b99-8b11-f722143fdb3c req-ba819a92-b43f-4b31-9a54-5aba4ccc0e93 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updated VIF entry in instance network info cache for port 2091ba8c-9169-470d-8796-83b024957634. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG nova.network.neutron [req-970388f0-55bc-4b99-8b11-f722143fdb3c req-ba819a92-b43f-4b31-9a54-5aba4ccc0e93 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updating instance_info_cache with network_info: [{"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-970388f0-55bc-4b99-8b11-f722143fdb3c req-ba819a92-b43f-4b31-9a54-5aba4ccc0e93 service nova] Releasing lock "refresh_cache-837f647d-b7d5-40fa-bbcb-a5748786ed90" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:44 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:40:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:40:48 user nova-compute[74482]: DEBUG nova.objects.instance [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'flavor' on Instance uuid 837f647d-b7d5-40fa-bbcb-a5748786ed90 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:40:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:40:49 user nova-compute[74482]: INFO nova.compute.manager [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Attaching volume 7d5ca580-fc3a-4501-af5f-89375424a0ee to /dev/vdb
Oct 23 23:40:49 user nova-compute[74482]: DEBUG os_brick.utils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb86f3c-7f62-40ec-b00c-32681f8ffe5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90abb403-37d5-43fd-9516-e490be4dd418]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a57424-40bd-4cd4-85d4-852a93b931a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb91ada-8285-4d9d-8c2e-d94ef33ab92c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:40:49 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:40:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cffdea-e40d-4660-8c4d-996fa3ad7d41]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG os_brick.utils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updating existing volume attachment record: e72ecf41-579c-4178-a754-b3d967c1f38d {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:40:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:40:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:40:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:40:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:56 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:40:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:40:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:40:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:40:56 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:40:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:40:57 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:40:57 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=24.93984603881836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:40:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:40:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:40:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRMnkvfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:41:05 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:41:05 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:41:05 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aceafa-87e1-4366-9258-a0c8d3835137]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:41:05 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aefaac1-939d-4887-8ad4-9b309c54ba5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee] added
Oct 23 23:41:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6a01ef-ff50-44d3-b870-02a6bebb2f91]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c7964-4db5-4ccd-a064-71b074fd1080]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRMnkvfi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LRMnkvfi" returned: 0 in 0.028s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92b023a-9a43-4e65-a708-a3b15aa137b0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LRMnkvfi'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdcf3db-db33-467d-beae-b1a02415da33]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d0af69-3d8d-4453-aa47-f7de8ea6b6f9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:41:05 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:41:05 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:41:05 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:41:05 user nova-compute[74482]: 
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b5c2c6-6c1f-4ffc-bfe4-e0afbb04eb54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee, portal: 172.16.0.220,3260]
Oct 23 23:41:05 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee, portal: 172.16.0.220,3260] successful.
Oct 23 23:41:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb500ddb-718d-4a18-a59d-1c4147bf8b43]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d73bacc-7c6e-4d12-8c4f-e768377f3ef2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee (non-flash)
Oct 23 23:41:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee (non-flash)
Oct 23 23:41:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[844aa497-9341-4f1d-a462-9eba15279075]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:41:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRMnkvfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:41:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:41:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26631336432623136', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:41:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631336432623136', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:41:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'flavor' on Instance uuid 837f647d-b7d5-40fa-bbcb-a5748786ed90 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:41:06 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:41:06 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:41:06 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:41:06 user nova-compute[74482]:   <serial>7d5ca580-fc3a-4501-af5f-89375424a0ee</serial>
Oct 23 23:41:06 user nova-compute[74482]: </disk>
Oct 23 23:41:06 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:41:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:41:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:41:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] No VIF found with MAC fa:16:3e:f3:a0:6f, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:41:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-11e98d1d-4c0d-41e6-8c35-c37ba301c636 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.883s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:07 user nova-compute[74482]: INFO nova.compute.manager [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Detaching volume 7d5ca580-fc3a-4501-af5f-89375424a0ee
Oct 23 23:41:07 user nova-compute[74482]: INFO nova.virt.block_device [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Attempting to driver detach volume 7d5ca580-fc3a-4501-af5f-89375424a0ee from mountpoint /dev/vdb
Oct 23 23:41:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Attempting to detach device vdb from instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:41:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:41:07 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:41:07 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:41:07 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:41:07 user nova-compute[74482]:   <serial>7d5ca580-fc3a-4501-af5f-89375424a0ee</serial>
Oct 23 23:41:07 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:41:07 user nova-compute[74482]: </disk>
Oct 23 23:41:07 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:41:07 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully detached device vdb from instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 from the persistent domain config.
Oct 23 23:41:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:41:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:41:07 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:41:07 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:41:07 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:41:07 user nova-compute[74482]:   <serial>7d5ca580-fc3a-4501-af5f-89375424a0ee</serial>
Oct 23 23:41:07 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:41:07 user nova-compute[74482]: </disk>
Oct 23 23:41:07 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:41:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:41:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:41:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:41:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:41:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:41:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:41:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:20 user nova-compute[74482]: INFO nova.compute.manager [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Unshelving
Oct 23 23:41:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'pci_requests' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'numa_topology' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:41:21 user nova-compute[74482]: INFO nova.compute.claims [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Claim successful on node user
Oct 23 23:41:21 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:21 user nova-compute[74482]: INFO nova.network.neutron [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating port 7482c2bd-205e-4f9e-9991-23d94ed4d8a2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquired lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:41:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-45f45696-c686-474e-a190-ab1987a8260d req-ee34e403-c9b5-48c5-b44c-c499226a556f service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-changed-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-45f45696-c686-474e-a190-ab1987a8260d req-ee34e403-c9b5-48c5-b44c-c499226a556f service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Refreshing instance network info cache due to event network-changed-7482c2bd-205e-4f9e-9991-23d94ed4d8a2. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45f45696-c686-474e-a190-ab1987a8260d req-ee34e403-c9b5-48c5-b44c-c499226a556f service nova] Acquiring lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Releasing lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:41:22 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Creating image(s)
Oct 23 23:41:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'trusted_certs' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45f45696-c686-474e-a190-ab1987a8260d req-ee34e403-c9b5-48c5-b44c-c499226a556f service nova] Acquired lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-45f45696-c686-474e-a190-ab1987a8260d req-ee34e403-c9b5-48c5-b44c-c499226a556f service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Refreshing network info cache for port 7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG nova.objects.base [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<e56a49cf-72c8-4aba-9a99-bc015f89a7a2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "2c974ea9e38eb1c4c2f1680ca25a0429ab65228f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "2c974ea9e38eb1c4c2f1680ca25a0429ab65228f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f.part --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f.part --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:23 user nova-compute[74482]: DEBUG nova.virt.images [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] b7a4376c-534c-45b8-a1ed-bd11c95eb918 was qcow2, converting to raw {{(pid=74482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 23:41:23 user nova-compute[74482]: DEBUG nova.privsep.utils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 23:41:23 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f.part /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f.converted {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-45f45696-c686-474e-a190-ab1987a8260d req-ee34e403-c9b5-48c5-b44c-c499226a556f service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updated VIF entry in instance network info cache for port 7482c2bd-205e-4f9e-9991-23d94ed4d8a2. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:41:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-45f45696-c686-474e-a190-ab1987a8260d req-ee34e403-c9b5-48c5-b44c-c499226a556f service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:41:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-45f45696-c686-474e-a190-ab1987a8260d req-ee34e403-c9b5-48c5-b44c-c499226a556f service nova] Releasing lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f.part /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f.converted" returned: 0 in 0.589s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f.converted --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "2c974ea9e38eb1c4c2f1680ca25a0429ab65228f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.859s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f --force-share --output=json" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "2c974ea9e38eb1c4c2f1680ca25a0429ab65228f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "2c974ea9e38eb1c4c2f1680ca25a0429ab65228f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f --force-share --output=json" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f,backing_fmt=raw /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f,backing_fmt=raw /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk 1073741824" returned: 0 in 0.053s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "2c974ea9e38eb1c4c2f1680ca25a0429ab65228f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'migration_context' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:24 user nova-compute[74482]: DEBUG nova.objects.base [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<e56a49cf-72c8-4aba-9a99-bc015f89a7a2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:41:24 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Rebasing disk image.
Oct 23 23:41:24 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.190s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae -F raw /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae -F raw /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk" returned: 0 in 2.160s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Ensure instance console log exists: /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Start _get_guest_xml network_info=[{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5e46ad31e35ddae221de113286e56eed',container_format='bare',created_at=2023-10-23T23:39:28Z,direct_url=<?>,disk_format='qcow2',id=b7a4376c-534c-45b8-a1ed-bd11c95eb918,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1291592244-shelved',owner='5ba7757462104f96812975fbc57a47c8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T23:39:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:41:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:41:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5e46ad31e35ddae221de113286e56eed',container_format='bare',created_at=2023-10-23T23:39:28Z,direct_url=<?>,disk_format='qcow2',id=b7a4376c-534c-45b8-a1ed-bd11c95eb918,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1291592244-shelved',owner='5ba7757462104f96812975fbc57a47c8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T23:39:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'vcpu_model' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.objects.base [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<e56a49cf-72c8-4aba-9a99-bc015f89a7a2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291592244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291592244',id=43,image_ref='b7a4376c-534c-45b8-a1ed-bd11c95eb918',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1029898015',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-3j54stx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member',shelved_at='2023-10-23T23:39:32.198593',shelved_host='user',shelved_image_id='b7a4376c-534c-45b8-a1ed-bd11c95eb918'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=e56a49cf-72c8-4aba-9a99-bc015f89a7a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'pci_devices' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.objects.base [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Object Instance<e56a49cf-72c8-4aba-9a99-bc015f89a7a2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74482) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:41:27 user nova-compute[74482]:   <uuid>e56a49cf-72c8-4aba-9a99-bc015f89a7a2</uuid>
Oct 23 23:41:27 user nova-compute[74482]:   <name>instance-0000002b</name>
Oct 23 23:41:27 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:41:27 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:41:27 user nova-compute[74482]:   <metadata>
Oct 23 23:41:27 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:41:27 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:41:27 user nova-compute[74482]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1291592244</nova:name>
Oct 23 23:41:27 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:41:27</nova:creationTime>
Oct 23 23:41:27 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:41:27 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:41:27 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:41:27 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:41:27 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:41:27 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:41:27 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:41:27 user nova-compute[74482]:       <nova:owner>
Oct 23 23:41:27 user nova-compute[74482]:         <nova:user uuid="158ff13b4023443190e1f9a4d36fb1a9">tempest-AttachVolumeShelveTestJSON-1885712928-project-member</nova:user>
Oct 23 23:41:27 user nova-compute[74482]:         <nova:project uuid="5ba7757462104f96812975fbc57a47c8">tempest-AttachVolumeShelveTestJSON-1885712928</nova:project>
Oct 23 23:41:27 user nova-compute[74482]:       </nova:owner>
Oct 23 23:41:27 user nova-compute[74482]:       <nova:root type="image" uuid="b7a4376c-534c-45b8-a1ed-bd11c95eb918"/>
Oct 23 23:41:27 user nova-compute[74482]:       <nova:ports>
Oct 23 23:41:27 user nova-compute[74482]:         <nova:port uuid="7482c2bd-205e-4f9e-9991-23d94ed4d8a2">
Oct 23 23:41:27 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 23:41:27 user nova-compute[74482]:         </nova:port>
Oct 23 23:41:27 user nova-compute[74482]:       </nova:ports>
Oct 23 23:41:27 user nova-compute[74482]:     </nova:instance>
Oct 23 23:41:27 user nova-compute[74482]:   </metadata>
Oct 23 23:41:27 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:41:27 user nova-compute[74482]:     <system>
Oct 23 23:41:27 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:41:27 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:41:27 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:41:27 user nova-compute[74482]:       <entry name="serial">e56a49cf-72c8-4aba-9a99-bc015f89a7a2</entry>
Oct 23 23:41:27 user nova-compute[74482]:       <entry name="uuid">e56a49cf-72c8-4aba-9a99-bc015f89a7a2</entry>
Oct 23 23:41:27 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:41:27 user nova-compute[74482]:     </system>
Oct 23 23:41:27 user nova-compute[74482]:   </sysinfo>
Oct 23 23:41:27 user nova-compute[74482]:   <os>
Oct 23 23:41:27 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:41:27 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:41:27 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:41:27 user nova-compute[74482]:   </os>
Oct 23 23:41:27 user nova-compute[74482]:   <features>
Oct 23 23:41:27 user nova-compute[74482]:     <acpi/>
Oct 23 23:41:27 user nova-compute[74482]:     <apic/>
Oct 23 23:41:27 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:41:27 user nova-compute[74482]:   </features>
Oct 23 23:41:27 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:41:27 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:41:27 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:41:27 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:41:27 user nova-compute[74482]:   </clock>
Oct 23 23:41:27 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:41:27 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:41:27 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:41:27 user nova-compute[74482]:   </cpu>
Oct 23 23:41:27 user nova-compute[74482]:   <devices>
Oct 23 23:41:27 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:41:27 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:41:27 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk"/>
Oct 23 23:41:27 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:41:27 user nova-compute[74482]:     </disk>
Oct 23 23:41:27 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:41:27 user nova-compute[74482]:       <mac address="fa:16:3e:04:f1:d2"/>
Oct 23 23:41:27 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:41:27 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:41:27 user nova-compute[74482]:       <target dev="tap7482c2bd-20"/>
Oct 23 23:41:27 user nova-compute[74482]:     </interface>
Oct 23 23:41:27 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:41:27 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/console.log" append="off"/>
Oct 23 23:41:27 user nova-compute[74482]:     </serial>
Oct 23 23:41:27 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:41:27 user nova-compute[74482]:     <video>
Oct 23 23:41:27 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:41:27 user nova-compute[74482]:     </video>
Oct 23 23:41:27 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:41:27 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:41:27 user nova-compute[74482]:     </rng>
Oct 23 23:41:27 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:41:27 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:41:27 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:41:27 user nova-compute[74482]:     </memballoon>
Oct 23 23:41:27 user nova-compute[74482]:   </devices>
Oct 23 23:41:27 user nova-compute[74482]: </domain>
Oct 23 23:41:27 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291592244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291592244',id=43,image_ref='b7a4376c-534c-45b8-a1ed-bd11c95eb918',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1029898015',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-3j54stx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member',shelved_at='2023-10-23T23:39:32.198593',shelved_host='user',shelved_image_id='b7a4376c-534c-45b8-a1ed-bd11c95eb918'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=e56a49cf-72c8-4aba-9a99-bc015f89a7a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG os_vif [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a444e493-1d19-5026-9e26-3ce5a78602fd', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7482c2bd-20, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7482c2bd-20, col_values=(('qos', UUID('b8b62adb-f33d-4b38-ab10-0de031380105')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7482c2bd-20, col_values=(('external_ids', {'iface-id': '7482c2bd-205e-4f9e-9991-23d94ed4d8a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:f1:d2', 'vm-uuid': 'e56a49cf-72c8-4aba-9a99-bc015f89a7a2'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:27 user nova-compute[74482]: INFO os_vif [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20')
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:41:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] No VIF found with MAC fa:16:3e:04:f1:d2, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:41:28 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 is timed out.
Oct 23 23:41:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully detached device vdb from instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 from the live domain config.
Oct 23 23:41:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LRMnkvfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:41:28 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc6d8b-8254-4404-b867-37742490a50b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:41:28 user nova-compute[74482]: No targets found.
Oct 23 23:41:28 user nova-compute[74482]: iSNS:
Oct 23 23:41:28 user nova-compute[74482]: No targets found.
Oct 23 23:41:28 user nova-compute[74482]: STATIC:
Oct 23 23:41:28 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee
Oct 23 23:41:28 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:41:28 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:41:28 user nova-compute[74482]: FIRMWARE:
Oct 23 23:41:28 user nova-compute[74482]: No targets found.
Oct 23 23:41:28 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:41:28 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:41:28 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82adce2-dcb6-473c-b6de-3e348a08f981]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d866d673-e9ad-4f8b-8599-fc0969a124b4]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee (non-flash)
Oct 23 23:41:28 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee (non-flash)
Oct 23 23:41:28 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c551360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[769013dc-a6ab-4b19-bf5d-65bffc825b27]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7740a24f-16ed-42ec-9b3d-bd230fd165ee]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe107d5-fe24-4ccf-a416-272d7a8e1f03]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b2ebe8-49c5-4594-afe7-f2e4f1c22e2c]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eed480-9263-4059-8cee-f992dd90c4b7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbd2b8d-529d-4e2f-8b48-f5ee01afb5ef]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee, portal: 172.16.0.220,3260]
Oct 23 23:41:28 user nova-compute[74482]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee, portal: 172.16.0.220,3260] successful.
Oct 23 23:41:28 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d5ca580-fc3a-4501-af5f-89375424a0ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[652eaa83-1e57-4450-9d31-758c51a0c531]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] <== disconnect_volume: return (250ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-73a46023-c186-4c53-badf-9d1c9a0768d3 req-c360112b-d2e9-40e3-b00c-b399e57f78f6 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-73a46023-c186-4c53-badf-9d1c9a0768d3 req-c360112b-d2e9-40e3-b00c-b399e57f78f6 service nova] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-73a46023-c186-4c53-badf-9d1c9a0768d3 req-c360112b-d2e9-40e3-b00c-b399e57f78f6 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-73a46023-c186-4c53-badf-9d1c9a0768d3 req-c360112b-d2e9-40e3-b00c-b399e57f78f6 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG nova.compute.manager [req-73a46023-c186-4c53-badf-9d1c9a0768d3 req-c360112b-d2e9-40e3-b00c-b399e57f78f6 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] No waiting events found dispatching network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:41:29 user nova-compute[74482]: WARNING nova.compute.manager [req-73a46023-c186-4c53-badf-9d1c9a0768d3 req-c360112b-d2e9-40e3-b00c-b399e57f78f6 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received unexpected event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 23:41:29 user nova-compute[74482]: DEBUG nova.objects.instance [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'flavor' on Instance uuid 837f647d-b7d5-40fa-bbcb-a5748786ed90 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-86eb0997-03c6-4db0-b9aa-f74ff343a301 tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:41:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:41:31 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance spawned successfully.
Oct 23 23:41:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-1485d88c-fe3b-4189-95b6-90e194be5209 req-599e230c-d442-4b46-844d-c75c8c09fb5f service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:41:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1485d88c-fe3b-4189-95b6-90e194be5209 req-599e230c-d442-4b46-844d-c75c8c09fb5f service nova] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1485d88c-fe3b-4189-95b6-90e194be5209 req-599e230c-d442-4b46-844d-c75c8c09fb5f service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1485d88c-fe3b-4189-95b6-90e194be5209 req-599e230c-d442-4b46-844d-c75c8c09fb5f service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-1485d88c-fe3b-4189-95b6-90e194be5209 req-599e230c-d442-4b46-844d-c75c8c09fb5f service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] No waiting events found dispatching network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:41:31 user nova-compute[74482]: WARNING nova.compute.manager [req-1485d88c-fe3b-4189-95b6-90e194be5209 req-599e230c-d442-4b46-844d-c75c8c09fb5f service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received unexpected event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 23:41:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:41:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-f65e6424-54a2-4c2a-8e41-eaf019e78adb tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.392s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:40 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:41:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:41:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:41:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:41:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:41:40 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [{"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:41:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-e56a49cf-72c8-4aba-9a99-bc015f89a7a2" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:41:41 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:41:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:41 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:41:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:41:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:41:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:41:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:41:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:41:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:41:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:56 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:41:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:56 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:41:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:41:57 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:41:57 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:41:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8746MB free_disk=24.913265228271484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:57 user nova-compute[74482]: INFO nova.compute.manager [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Terminating instance
Oct 23 23:41:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 837f647d-b7d5-40fa-bbcb-a5748786ed90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e56a49cf-72c8-4aba-9a99-bc015f89a7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-4e9c862c-3616-4b7e-a9e0-4cbe87bd066c req-a421fb7b-fe83-4789-b49b-127898e2d3a8 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-unplugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4e9c862c-3616-4b7e-a9e0-4cbe87bd066c req-a421fb7b-fe83-4789-b49b-127898e2d3a8 service nova] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4e9c862c-3616-4b7e-a9e0-4cbe87bd066c req-a421fb7b-fe83-4789-b49b-127898e2d3a8 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4e9c862c-3616-4b7e-a9e0-4cbe87bd066c req-a421fb7b-fe83-4789-b49b-127898e2d3a8 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-4e9c862c-3616-4b7e-a9e0-4cbe87bd066c req-a421fb7b-fe83-4789-b49b-127898e2d3a8 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] No waiting events found dispatching network-vif-unplugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-4e9c862c-3616-4b7e-a9e0-4cbe87bd066c req-a421fb7b-fe83-4789-b49b-127898e2d3a8 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-unplugged-2091ba8c-9169-470d-8796-83b024957634 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Instance destroyed successfully.
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.objects.instance [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lazy-loading 'resources' on Instance uuid 837f647d-b7d5-40fa-bbcb-a5748786ed90 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-198127378',display_name='tempest-AttachVolumeNegativeTest-server-198127378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-198127378',id=44,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs3xwPJFDNbMq3i5a/YBMcdU8gZ/vHZksDdIzo5b4b4y9rBWLGTI3FwkDSnHZYSB0BDegKqfOa89jmmwCw50I4QJJTUM0e0BedblwGBe+xy5QPyVM8lyOePGFWdxHKNCg==',key_name='tempest-keypair-259559258',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:38:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f035fff650c45109cdf0779013139ff',ramdisk_id='',reservation_id='r-kkk09eil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-873141491',owner_user_name='tempest-AttachVolumeNegativeTest-873141491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:38:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e723ee9b17d24a31b9d63246e0a6b054',uuid=837f647d-b7d5-40fa-bbcb-a5748786ed90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converting VIF {"id": "2091ba8c-9169-470d-8796-83b024957634", "address": "fa:16:3e:f3:a0:6f", "network": {"id": "540d69c1-ade8-4961-b561-7d1b66407a42", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1969851444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f035fff650c45109cdf0779013139ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2091ba8c-91", "ovs_interfaceid": "2091ba8c-9169-470d-8796-83b024957634", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a0:6f,bridge_name='br-int',has_traffic_filtering=True,id=2091ba8c-9169-470d-8796-83b024957634,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2091ba8c-91') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG os_vif [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a0:6f,bridge_name='br-int',has_traffic_filtering=True,id=2091ba8c-9169-470d-8796-83b024957634,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2091ba8c-91') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2091ba8c-91, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a07b268-d4e3-4333-846f-d52c239c48a9) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:41:58 user nova-compute[74482]: INFO os_vif [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a0:6f,bridge_name='br-int',has_traffic_filtering=True,id=2091ba8c-9169-470d-8796-83b024957634,network=Network(540d69c1-ade8-4961-b561-7d1b66407a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2091ba8c-91')
Oct 23 23:41:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Deleting instance files /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90_del
Oct 23 23:41:58 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Deletion of /opt/stack/data/nova/instances/837f647d-b7d5-40fa-bbcb-a5748786ed90_del complete
Oct 23 23:41:58 user nova-compute[74482]: INFO nova.compute.manager [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 23:41:58 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:41:58 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:41:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:41:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:42:00 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Took 1.43 seconds to deallocate network for instance.
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] No waiting events found dispatching network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:42:00 user nova-compute[74482]: WARNING nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received unexpected event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 for instance with vm_state deleted and task_state None.
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] No waiting events found dispatching network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:42:00 user nova-compute[74482]: WARNING nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received unexpected event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 for instance with vm_state deleted and task_state None.
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] No waiting events found dispatching network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:42:00 user nova-compute[74482]: WARNING nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received unexpected event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 for instance with vm_state deleted and task_state None.
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-unplugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] No waiting events found dispatching network-vif-unplugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:42:00 user nova-compute[74482]: WARNING nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received unexpected event network-vif-unplugged-2091ba8c-9169-470d-8796-83b024957634 for instance with vm_state deleted and task_state None.
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Acquiring lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] No waiting events found dispatching network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:42:00 user nova-compute[74482]: WARNING nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received unexpected event network-vif-plugged-2091ba8c-9169-470d-8796-83b024957634 for instance with vm_state deleted and task_state None.
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-fee40922-c0d8-4d4e-b627-839845923c93 req-edd1a0b2-d9a7-4c55-b917-d300e2be5460 service nova] [instance: 837f647d-b7d5-40fa-bbcb-a5748786ed90] Received event network-vif-deleted-2091ba8c-9169-470d-8796-83b024957634 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:42:00 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Deleted allocations for instance 837f647d-b7d5-40fa-bbcb-a5748786ed90
Oct 23 23:42:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6f54496c-6fea-4ed0-bb67-e7514ef199ba tempest-AttachVolumeNegativeTest-873141491 tempest-AttachVolumeNegativeTest-873141491-project-member] Lock "837f647d-b7d5-40fa-bbcb-a5748786ed90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.652s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:42:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:42:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:42:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:42:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:42:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:42:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:42:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:42:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:42:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:42:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:42:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:42:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:42:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:42:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:42:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:42:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:42:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:42:42 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:42:42 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:42:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:42:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:42:42 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:42:43 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:42:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:42:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:42:56 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:42:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:42:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:42:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:42:56 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:42:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:42:57 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:42:57 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:42:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8927MB free_disk=24.940200805664062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e56a49cf-72c8-4aba-9a99-bc015f89a7a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:42:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:42:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:43:11 user nova-compute[74482]: INFO nova.compute.manager [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Terminating instance
Oct 23 23:43:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-506c72cd-5d1d-4595-8c09-be85c9ec23d9 req-1a85b4d4-5252-4a3e-9700-9668f5998f35 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-unplugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-506c72cd-5d1d-4595-8c09-be85c9ec23d9 req-1a85b4d4-5252-4a3e-9700-9668f5998f35 service nova] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-506c72cd-5d1d-4595-8c09-be85c9ec23d9 req-1a85b4d4-5252-4a3e-9700-9668f5998f35 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-506c72cd-5d1d-4595-8c09-be85c9ec23d9 req-1a85b4d4-5252-4a3e-9700-9668f5998f35 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-506c72cd-5d1d-4595-8c09-be85c9ec23d9 req-1a85b4d4-5252-4a3e-9700-9668f5998f35 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] No waiting events found dispatching network-vif-unplugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG nova.compute.manager [req-506c72cd-5d1d-4595-8c09-be85c9ec23d9 req-1a85b4d4-5252-4a3e-9700-9668f5998f35 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-unplugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:43:11 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Instance destroyed successfully.
Oct 23 23:43:11 user nova-compute[74482]: DEBUG nova.objects.instance [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lazy-loading 'resources' on Instance uuid e56a49cf-72c8-4aba-9a99-bc015f89a7a2 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T23:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291592244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291592244',id=43,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVaVomZMkoNG7OjlGId6TuSTZnCEov6pv5RlvMnj8R9ch3swK+VpvkLnAYKWrDektdl8lAA6yK7fup6d3WuCBSKxSAFGFgIJb3S0P42kMajiE4GZmKWpqa6/qnI6/1jDg==',key_name='tempest-keypair-1029898015',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:41:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ba7757462104f96812975fbc57a47c8',ramdisk_id='',reservation_id='r-3j54stx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1885712928',owner_user_name='tempest-AttachVolumeShelveTestJSON-1885712928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='158ff13b4023443190e1f9a4d36fb1a9',uuid=e56a49cf-72c8-4aba-9a99-bc015f89a7a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converting VIF {"id": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "address": "fa:16:3e:04:f1:d2", "network": {"id": "bd29e056-5b43-443c-801f-4962a3c3697d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-139753304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ba7757462104f96812975fbc57a47c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7482c2bd-20", "ovs_interfaceid": "7482c2bd-205e-4f9e-9991-23d94ed4d8a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG os_vif [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7482c2bd-20, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8b62adb-f33d-4b38-ab10-0de031380105) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:11 user nova-compute[74482]: INFO os_vif [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:f1:d2,bridge_name='br-int',has_traffic_filtering=True,id=7482c2bd-205e-4f9e-9991-23d94ed4d8a2,network=Network(bd29e056-5b43-443c-801f-4962a3c3697d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7482c2bd-20')
Oct 23 23:43:11 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Deleting instance files /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2_del
Oct 23 23:43:11 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Deletion of /opt/stack/data/nova/instances/e56a49cf-72c8-4aba-9a99-bc015f89a7a2_del complete
Oct 23 23:43:12 user nova-compute[74482]: INFO nova.compute.manager [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Took 0.72 seconds to destroy the instance on the hypervisor.
Oct 23 23:43:12 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:43:12 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:43:12 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:43:12 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:43:12 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Took 0.85 seconds to deallocate network for instance.
Oct 23 23:43:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:43:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:43:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-249819be-480f-4ab9-a1d7-d40dacf5c619 req-091b9344-0e52-4743-b8d9-d3631f48cccb service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-deleted-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:43:12 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:43:12 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:43:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:43:13 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Deleted allocations for instance e56a49cf-72c8-4aba-9a99-bc015f89a7a2
Oct 23 23:43:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-589c9332-0a5b-4b13-b19d-2f5656f353c5 tempest-AttachVolumeShelveTestJSON-1885712928 tempest-AttachVolumeShelveTestJSON-1885712928-project-member] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.870s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:43:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-49ed3d15-57a9-47dc-9688-2d642c70fa7c req-b9cc7f5d-cd03-4621-9ab0-6cd3daeedda8 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:43:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49ed3d15-57a9-47dc-9688-2d642c70fa7c req-b9cc7f5d-cd03-4621-9ab0-6cd3daeedda8 service nova] Acquiring lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:43:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49ed3d15-57a9-47dc-9688-2d642c70fa7c req-b9cc7f5d-cd03-4621-9ab0-6cd3daeedda8 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:43:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49ed3d15-57a9-47dc-9688-2d642c70fa7c req-b9cc7f5d-cd03-4621-9ab0-6cd3daeedda8 service nova] Lock "e56a49cf-72c8-4aba-9a99-bc015f89a7a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:43:13 user nova-compute[74482]: DEBUG nova.compute.manager [req-49ed3d15-57a9-47dc-9688-2d642c70fa7c req-b9cc7f5d-cd03-4621-9ab0-6cd3daeedda8 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] No waiting events found dispatching network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:43:13 user nova-compute[74482]: WARNING nova.compute.manager [req-49ed3d15-57a9-47dc-9688-2d642c70fa7c req-b9cc7f5d-cd03-4621-9ab0-6cd3daeedda8 service nova] [instance: e56a49cf-72c8-4aba-9a99-bc015f89a7a2] Received unexpected event network-vif-plugged-7482c2bd-205e-4f9e-9991-23d94ed4d8a2 for instance with vm_state deleted and task_state None.
Oct 23 23:43:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:42 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:43:43 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:43 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:43:43 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:43:43 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:43:45 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:43:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:43:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:43:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:43:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:43:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:43:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:43:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:43:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:43:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:43:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:43:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:43:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:43:58 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:43:58 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:43:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9129MB free_disk=24.96661376953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:43:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:43:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:43:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:43:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:43:58 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:43:58 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:43:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:43:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:44:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:44:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:44:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:44:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:44:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:44:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:44:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:44:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:44:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:44:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:44:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:44:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:44:42 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:44:43 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:44:43 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:44:43 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:44:44 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:44:45 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:44:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:44:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:44:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:44:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:44:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:44:48 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:44:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:44:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:44:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:44:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:44:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:44:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:44:57 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:44:58 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:44:58 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:44:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9130MB free_disk=24.957355499267578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:44:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:44:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:44:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:44:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:44:58 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:44:58 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:44:58 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:44:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:45:29 user nova-compute[74482]: INFO nova.compute.claims [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Claim successful on node user
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.190s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:45:29 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.policy [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecdf539ebf6a424c96f5703450da22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5f8a6ca9ed41558cc68c4d1620674f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:45:29 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Creating image(s)
Oct 23 23:45:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "/opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "/opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "/opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk 1073741824" returned: 0 in 0.148s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Successfully created port: 69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Cannot resize image /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Ensure instance console log exists: /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:45:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Successfully updated port: 69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquired lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-5d9a48d3-c70b-4094-a35c-bcf6ed9b7147 req-46b6d276-dfa4-4ac4-8afe-02b14a93ea56 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received event network-changed-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.compute.manager [req-5d9a48d3-c70b-4094-a35c-bcf6ed9b7147 req-46b6d276-dfa4-4ac4-8afe-02b14a93ea56 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Refreshing instance network info cache due to event network-changed-69a0f485-7730-44c0-86bc-ca6e03b6198e. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5d9a48d3-c70b-4094-a35c-bcf6ed9b7147 req-46b6d276-dfa4-4ac4-8afe-02b14a93ea56 service nova] Acquiring lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.neutron [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updating instance_info_cache with network_info: [{"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Releasing lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Instance network_info: |[{"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5d9a48d3-c70b-4094-a35c-bcf6ed9b7147 req-46b6d276-dfa4-4ac4-8afe-02b14a93ea56 service nova] Acquired lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.neutron [req-5d9a48d3-c70b-4094-a35c-bcf6ed9b7147 req-46b6d276-dfa4-4ac4-8afe-02b14a93ea56 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Refreshing network info cache for port 69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Start _get_guest_xml network_info=[{"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:45:31 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:45:31 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1292988851',display_name='tempest-VolumesSnapshotTestJSON-instance-1292988851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1292988851',id=45,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXfIn1T0dl0mZCL6oBt3DGp1dLoeNJ5GwOi+QQpzD0cWDIUqba7u1RerBQkr61BdxdCztPSW6qMrby810SMQ4Mvi0MeWIarHYKIArPpFr0bqvucDowQWaRaRz20Fy505g==',key_name='tempest-keypair-1045778721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e5f8a6ca9ed41558cc68c4d1620674f',ramdisk_id='',reservation_id='r-650ebrlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1314827273',owner_user_name='tempest-VolumesSnapshotTestJSON-1314827273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecdf539ebf6a424c96f5703450da22fc',uuid=084b09fc-f359-4989-938d-c3caf5a870ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converting VIF {"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:77:32,bridge_name='br-int',has_traffic_filtering=True,id=69a0f485-7730-44c0-86bc-ca6e03b6198e,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a0f485-77') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'pci_devices' on Instance uuid 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:45:31 user nova-compute[74482]:   <uuid>084b09fc-f359-4989-938d-c3caf5a870ad</uuid>
Oct 23 23:45:31 user nova-compute[74482]:   <name>instance-0000002d</name>
Oct 23 23:45:31 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:45:31 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:45:31 user nova-compute[74482]:   <metadata>
Oct 23 23:45:31 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:45:31 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:45:31 user nova-compute[74482]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1292988851</nova:name>
Oct 23 23:45:31 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:45:31</nova:creationTime>
Oct 23 23:45:31 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:45:31 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:45:31 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:45:31 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:45:31 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:45:31 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:45:31 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:45:31 user nova-compute[74482]:       <nova:owner>
Oct 23 23:45:31 user nova-compute[74482]:         <nova:user uuid="ecdf539ebf6a424c96f5703450da22fc">tempest-VolumesSnapshotTestJSON-1314827273-project-member</nova:user>
Oct 23 23:45:31 user nova-compute[74482]:         <nova:project uuid="5e5f8a6ca9ed41558cc68c4d1620674f">tempest-VolumesSnapshotTestJSON-1314827273</nova:project>
Oct 23 23:45:31 user nova-compute[74482]:       </nova:owner>
Oct 23 23:45:31 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:45:31 user nova-compute[74482]:       <nova:ports>
Oct 23 23:45:31 user nova-compute[74482]:         <nova:port uuid="69a0f485-7730-44c0-86bc-ca6e03b6198e">
Oct 23 23:45:31 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 23:45:31 user nova-compute[74482]:         </nova:port>
Oct 23 23:45:31 user nova-compute[74482]:       </nova:ports>
Oct 23 23:45:31 user nova-compute[74482]:     </nova:instance>
Oct 23 23:45:31 user nova-compute[74482]:   </metadata>
Oct 23 23:45:31 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:45:31 user nova-compute[74482]:     <system>
Oct 23 23:45:31 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:45:31 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:45:31 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:45:31 user nova-compute[74482]:       <entry name="serial">084b09fc-f359-4989-938d-c3caf5a870ad</entry>
Oct 23 23:45:31 user nova-compute[74482]:       <entry name="uuid">084b09fc-f359-4989-938d-c3caf5a870ad</entry>
Oct 23 23:45:31 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:45:31 user nova-compute[74482]:     </system>
Oct 23 23:45:31 user nova-compute[74482]:   </sysinfo>
Oct 23 23:45:31 user nova-compute[74482]:   <os>
Oct 23 23:45:31 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:45:31 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:45:31 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:45:31 user nova-compute[74482]:   </os>
Oct 23 23:45:31 user nova-compute[74482]:   <features>
Oct 23 23:45:31 user nova-compute[74482]:     <acpi/>
Oct 23 23:45:31 user nova-compute[74482]:     <apic/>
Oct 23 23:45:31 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:45:31 user nova-compute[74482]:   </features>
Oct 23 23:45:31 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:45:31 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:45:31 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:45:31 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:45:31 user nova-compute[74482]:   </clock>
Oct 23 23:45:31 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:45:31 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:45:31 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:45:31 user nova-compute[74482]:   </cpu>
Oct 23 23:45:31 user nova-compute[74482]:   <devices>
Oct 23 23:45:31 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:45:31 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:45:31 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk"/>
Oct 23 23:45:31 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:45:31 user nova-compute[74482]:     </disk>
Oct 23 23:45:31 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:45:31 user nova-compute[74482]:       <mac address="fa:16:3e:fc:77:32"/>
Oct 23 23:45:31 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:45:31 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:45:31 user nova-compute[74482]:       <target dev="tap69a0f485-77"/>
Oct 23 23:45:31 user nova-compute[74482]:     </interface>
Oct 23 23:45:31 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:45:31 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/console.log" append="off"/>
Oct 23 23:45:31 user nova-compute[74482]:     </serial>
Oct 23 23:45:31 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:45:31 user nova-compute[74482]:     <video>
Oct 23 23:45:31 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:45:31 user nova-compute[74482]:     </video>
Oct 23 23:45:31 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:45:31 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:45:31 user nova-compute[74482]:     </rng>
Oct 23 23:45:31 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:45:31 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:45:31 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:45:31 user nova-compute[74482]:     </memballoon>
Oct 23 23:45:31 user nova-compute[74482]:   </devices>
Oct 23 23:45:31 user nova-compute[74482]: </domain>
Oct 23 23:45:31 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1292988851',display_name='tempest-VolumesSnapshotTestJSON-instance-1292988851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1292988851',id=45,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXfIn1T0dl0mZCL6oBt3DGp1dLoeNJ5GwOi+QQpzD0cWDIUqba7u1RerBQkr61BdxdCztPSW6qMrby810SMQ4Mvi0MeWIarHYKIArPpFr0bqvucDowQWaRaRz20Fy505g==',key_name='tempest-keypair-1045778721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e5f8a6ca9ed41558cc68c4d1620674f',ramdisk_id='',reservation_id='r-650ebrlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1314827273',owner_user_name='tempest-VolumesSnapshotTestJSON-1314827273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecdf539ebf6a424c96f5703450da22fc',uuid=084b09fc-f359-4989-938d-c3caf5a870ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converting VIF {"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:77:32,bridge_name='br-int',has_traffic_filtering=True,id=69a0f485-7730-44c0-86bc-ca6e03b6198e,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a0f485-77') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG os_vif [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:77:32,bridge_name='br-int',has_traffic_filtering=True,id=69a0f485-7730-44c0-86bc-ca6e03b6198e,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a0f485-77') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd674c54b-29d4-588c-8f47-32525abc1467', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69a0f485-77, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69a0f485-77, col_values=(('qos', UUID('519b63d5-32be-4751-9d30-f6c50fed623c')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69a0f485-77, col_values=(('external_ids', {'iface-id': '69a0f485-7730-44c0-86bc-ca6e03b6198e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:77:32', 'vm-uuid': '084b09fc-f359-4989-938d-c3caf5a870ad'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:31 user nova-compute[74482]: INFO os_vif [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:77:32,bridge_name='br-int',has_traffic_filtering=True,id=69a0f485-7730-44c0-86bc-ca6e03b6198e,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a0f485-77')
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No VIF found with MAC fa:16:3e:fc:77:32, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.neutron [req-5d9a48d3-c70b-4094-a35c-bcf6ed9b7147 req-46b6d276-dfa4-4ac4-8afe-02b14a93ea56 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updated VIF entry in instance network info cache for port 69a0f485-7730-44c0-86bc-ca6e03b6198e. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG nova.network.neutron [req-5d9a48d3-c70b-4094-a35c-bcf6ed9b7147 req-46b6d276-dfa4-4ac4-8afe-02b14a93ea56 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updating instance_info_cache with network_info: [{"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:45:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5d9a48d3-c70b-4094-a35c-bcf6ed9b7147 req-46b6d276-dfa4-4ac4-8afe-02b14a93ea56 service nova] Releasing lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-825401af-3502-4d09-a5d1-89b866ea8aba req-df1a0d87-3100-4edb-8298-29b9d6f24045 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received event network-vif-plugged-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-825401af-3502-4d09-a5d1-89b866ea8aba req-df1a0d87-3100-4edb-8298-29b9d6f24045 service nova] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-825401af-3502-4d09-a5d1-89b866ea8aba req-df1a0d87-3100-4edb-8298-29b9d6f24045 service nova] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-825401af-3502-4d09-a5d1-89b866ea8aba req-df1a0d87-3100-4edb-8298-29b9d6f24045 service nova] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG nova.compute.manager [req-825401af-3502-4d09-a5d1-89b866ea8aba req-df1a0d87-3100-4edb-8298-29b9d6f24045 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] No waiting events found dispatching network-vif-plugged-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:45:33 user nova-compute[74482]: WARNING nova.compute.manager [req-825401af-3502-4d09-a5d1-89b866ea8aba req-df1a0d87-3100-4edb-8298-29b9d6f24045 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received unexpected event network-vif-plugged-69a0f485-7730-44c0-86bc-ca6e03b6198e for instance with vm_state building and task_state spawning.
Oct 23 23:45:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:45:35 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Instance spawned successfully.
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:45:35 user nova-compute[74482]: INFO nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Took 5.32 seconds to spawn the instance on the hypervisor.
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:45:35 user nova-compute[74482]: INFO nova.compute.manager [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Took 5.83 seconds to build instance.
Oct 23 23:45:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d54fcef6-faf8-4391-a2c1-d31180ae4e73 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.950s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.compute.manager [req-108639aa-7ccf-4cad-9f94-5b876858ff5e req-3ea199a4-8f21-440f-a2e6-59939a14d8d0 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received event network-vif-plugged-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-108639aa-7ccf-4cad-9f94-5b876858ff5e req-3ea199a4-8f21-440f-a2e6-59939a14d8d0 service nova] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-108639aa-7ccf-4cad-9f94-5b876858ff5e req-3ea199a4-8f21-440f-a2e6-59939a14d8d0 service nova] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-108639aa-7ccf-4cad-9f94-5b876858ff5e req-3ea199a4-8f21-440f-a2e6-59939a14d8d0 service nova] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:35 user nova-compute[74482]: DEBUG nova.compute.manager [req-108639aa-7ccf-4cad-9f94-5b876858ff5e req-3ea199a4-8f21-440f-a2e6-59939a14d8d0 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] No waiting events found dispatching network-vif-plugged-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:45:35 user nova-compute[74482]: WARNING nova.compute.manager [req-108639aa-7ccf-4cad-9f94-5b876858ff5e req-3ea199a4-8f21-440f-a2e6-59939a14d8d0 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received unexpected event network-vif-plugged-69a0f485-7730-44c0-86bc-ca6e03b6198e for instance with vm_state active and task_state None.
Oct 23 23:45:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:43 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:43 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:43 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:43 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:45:44 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:45 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:45:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:45:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:45:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:45:45 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:45:45 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updating instance_info_cache with network_info: [{"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:45:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:48 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_power_states {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 23:45:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:45:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:45:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:45:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:45:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:45:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:45:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:45:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:45:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:45:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:45:59 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:45:59 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:46:00 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:46:00 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=24.92681884765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 084b09fc-f359-4989-938d-c3caf5a870ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:46:00 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:46:01 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:46:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:46:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:46:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:46:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:46:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:46:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:46:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:46:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:46:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:46:44 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:46:45 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:46:45 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:46:45 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:46:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:46:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:46:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:46:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:46:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:46:46 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:46:46 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:46:47 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updating instance_info_cache with network_info: [{"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:46:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:46:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:46:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:46:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:46:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:46:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:46:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:46:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:46:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:46:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:46:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:46:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:47:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:47:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.926074981689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 084b09fc-f359-4989-938d-c3caf5a870ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:47:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:47:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:47:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:47:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-b8116bdb-ce85-43b1-bd6c-79512cfee0ed req-96dcbe0a-032d-491b-a241-9c96511c1084 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received event network-changed-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-b8116bdb-ce85-43b1-bd6c-79512cfee0ed req-96dcbe0a-032d-491b-a241-9c96511c1084 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Refreshing instance network info cache due to event network-changed-69a0f485-7730-44c0-86bc-ca6e03b6198e. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b8116bdb-ce85-43b1-bd6c-79512cfee0ed req-96dcbe0a-032d-491b-a241-9c96511c1084 service nova] Acquiring lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b8116bdb-ce85-43b1-bd6c-79512cfee0ed req-96dcbe0a-032d-491b-a241-9c96511c1084 service nova] Acquired lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-b8116bdb-ce85-43b1-bd6c-79512cfee0ed req-96dcbe0a-032d-491b-a241-9c96511c1084 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Refreshing network info cache for port 69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'flavor' on Instance uuid 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:47:20 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Ignoring supplied device name: /dev/vdb
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:47:20 user nova-compute[74482]: INFO nova.compute.manager [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Attaching volume 3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 to /dev/vdb
Oct 23 23:47:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-b8116bdb-ce85-43b1-bd6c-79512cfee0ed req-96dcbe0a-032d-491b-a241-9c96511c1084 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updated VIF entry in instance network info cache for port 69a0f485-7730-44c0-86bc-ca6e03b6198e. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-b8116bdb-ce85-43b1-bd6c-79512cfee0ed req-96dcbe0a-032d-491b-a241-9c96511c1084 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updating instance_info_cache with network_info: [{"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-b8116bdb-ce85-43b1-bd6c-79512cfee0ed req-96dcbe0a-032d-491b-a241-9c96511c1084 service nova] Releasing lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG os_brick.utils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c63ecd-b7bc-408c-b832-37f36bab408b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:20 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdf8df8-9d0f-45f0-aebf-38c5477f8b91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9703ef8-2f60-4a25-88bb-53f522f3ae45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ed6049-7466-48ba-a605-2add2cdd5d35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:47:21 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:47:21 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e693605-fcd1-4266-8e8e-0089e09878b9]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG os_brick.utils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updating existing volume attachment record: bc9c2391-8708-490b-b7a1-0845979156ae {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:47:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zahYSulB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:47:46 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:47:46 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:47:46 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14d9a3b-4609-47b7-888a-18e1d58fa78b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:47:46 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f7bb9f-dabb-4efc-9bd8-18d974c64b59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1] added
Oct 23 23:47:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6611b86-b99a-4428-a87d-7ad750ff7b96]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[31186156-3e00-444d-9676-da75ff1e1728]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zahYSulB {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zahYSulB" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7439997b-e4bf-4d01-9c6a-23398dc85389]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zahYSulB'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcc66b6-7244-4a3f-8d1b-a815c04bc09c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb791ca-b86c-45ff-b792-e0fc91010fed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:47:46 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:47:46 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:47:46 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:47:46 user nova-compute[74482]: 
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a96c54d-9b4f-4158-bc69-29eb499d8f96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1, portal: 172.16.0.220,3260]
Oct 23 23:47:46 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1, portal: 172.16.0.220,3260] successful.
Oct 23 23:47:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c27caa0-09f1-4456-8676-429a32ca6f53]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ff66e5-815e-4f64-88e3-0de2fd6b3816]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 (non-flash)
Oct 23 23:47:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 (non-flash)
Oct 23 23:47:46 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[976091ca-55a2-49f0-8459-89c7e88e6724]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zahYSulB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23136653662613532', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136653662613532', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'flavor' on Instance uuid 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:47:47 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:47:47 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:47:47 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:47:47 user nova-compute[74482]:   <serial>3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1</serial>
Oct 23 23:47:47 user nova-compute[74482]: </disk>
Oct 23 23:47:47 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:47:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No VIF found with MAC fa:16:3e:fc:77:32, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:47:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ee5b9631-456c-43aa-acc7-e133885ba3d1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.161s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:47:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updating instance_info_cache with network_info: [{"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:47:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-084b09fc-f359-4989-938d-c3caf5a870ad" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:47:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:47:48 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:48 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:47:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:47:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:47:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:47:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:47:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:48:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:48:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:48:02 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:48:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=24.924976348876953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 084b09fc-f359-4989-938d-c3caf5a870ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:48:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:48:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:48:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:48:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:48:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:48:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:48:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:48:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:48:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:48:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:48:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:48:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:48:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:48:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:48:45 user nova-compute[74482]: INFO nova.compute.manager [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Detaching volume 3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1
Oct 23 23:48:45 user nova-compute[74482]: INFO nova.virt.block_device [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Attempting to driver detach volume 3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 from mountpoint /dev/vdb
Oct 23 23:48:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Attempting to detach device vdb from instance 084b09fc-f359-4989-938d-c3caf5a870ad from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:48:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:48:45 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:48:45 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:48:45 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:48:45 user nova-compute[74482]:   <serial>3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1</serial>
Oct 23 23:48:45 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:48:45 user nova-compute[74482]: </disk>
Oct 23 23:48:45 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:48:45 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Successfully detached device vdb from instance 084b09fc-f359-4989-938d-c3caf5a870ad from the persistent domain config.
Oct 23 23:48:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 084b09fc-f359-4989-938d-c3caf5a870ad from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:48:45 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:48:45 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:48:45 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:48:45 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:48:45 user nova-compute[74482]:   <serial>3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1</serial>
Oct 23 23:48:45 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:48:45 user nova-compute[74482]: </disk>
Oct 23 23:48:45 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:48:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:48:46 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:48:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:48:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:48:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:48:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:48:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:48:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:48:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:48:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:48:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:48:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Skipping network cache update for instance because it is being deleted. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 23 23:48:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:48:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:48:47 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:48:48 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:48:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:48:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:48:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:48:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:48:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:49:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:49:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:49:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:49:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:49:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:49:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:49:03 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:49:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:03 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:04 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:49:04 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:49:04 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=24.924030303955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 084b09fc-f359-4989-938d-c3caf5a870ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:49:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:49:06 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 084b09fc-f359-4989-938d-c3caf5a870ad is timed out.
Oct 23 23:49:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Successfully detached device vdb from instance 084b09fc-f359-4989-938d-c3caf5a870ad from the live domain config.
Oct 23 23:49:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zahYSulB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:49:06 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f344b9-9959-4ab8-8709-531f645604b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:49:06 user nova-compute[74482]: No targets found.
Oct 23 23:49:06 user nova-compute[74482]: iSNS:
Oct 23 23:49:06 user nova-compute[74482]: No targets found.
Oct 23 23:49:06 user nova-compute[74482]: STATIC:
Oct 23 23:49:06 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1
Oct 23 23:49:06 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:49:06 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:49:06 user nova-compute[74482]: FIRMWARE:
Oct 23 23:49:06 user nova-compute[74482]: No targets found.
Oct 23 23:49:06 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:49:06 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:49:06 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fba5acf-0ea2-4b19-be40-56387b7f4179]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d1287d-5ef5-4a6a-8050-104bcdf24140]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 (non-flash)
Oct 23 23:49:06 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 (non-flash)
Oct 23 23:49:06 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f304c76b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc99564b-5e77-409b-9939-8c00ae447967]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[19da661b-7ddc-4a7a-b2d5-ca98dc9f7ca2]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[275690ad-342f-44e2-ad39-eaeb1ec6229c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e604feba-6132-424b-99ef-3efe30cab159]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[31238248-4dd2-4713-9300-1a5056dcdbf0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3de822-aebe-412c-8d53-de1404b8dff9]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1, portal: 172.16.0.220,3260]
Oct 23 23:49:06 user nova-compute[74482]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1, portal: 172.16.0.220,3260] successful.
Oct 23 23:49:06 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb5a9e7-4f9d-436c-87be-912573807c8b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] <== disconnect_volume: return (292ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:49:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG nova.objects.instance [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'flavor' on Instance uuid 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-3176f9d0-5531-49de-9049-a60d886206b1 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.626s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.501s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:49:07 user nova-compute[74482]: INFO nova.compute.manager [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Terminating instance
Oct 23 23:49:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-91f41776-9c16-4df5-8870-5e8a29bd35cc req-d12dfc6a-983d-4681-b099-5471cbb2b7e4 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received event network-vif-unplugged-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-91f41776-9c16-4df5-8870-5e8a29bd35cc req-d12dfc6a-983d-4681-b099-5471cbb2b7e4 service nova] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-91f41776-9c16-4df5-8870-5e8a29bd35cc req-d12dfc6a-983d-4681-b099-5471cbb2b7e4 service nova] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-91f41776-9c16-4df5-8870-5e8a29bd35cc req-d12dfc6a-983d-4681-b099-5471cbb2b7e4 service nova] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-91f41776-9c16-4df5-8870-5e8a29bd35cc req-d12dfc6a-983d-4681-b099-5471cbb2b7e4 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] No waiting events found dispatching network-vif-unplugged-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-91f41776-9c16-4df5-8870-5e8a29bd35cc req-d12dfc6a-983d-4681-b099-5471cbb2b7e4 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received event network-vif-unplugged-69a0f485-7730-44c0-86bc-ca6e03b6198e for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:49:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Instance destroyed successfully.
Oct 23 23:49:08 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'resources' on Instance uuid 084b09fc-f359-4989-938d-c3caf5a870ad {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:45:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1292988851',display_name='tempest-VolumesSnapshotTestJSON-instance-1292988851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1292988851',id=45,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXfIn1T0dl0mZCL6oBt3DGp1dLoeNJ5GwOi+QQpzD0cWDIUqba7u1RerBQkr61BdxdCztPSW6qMrby810SMQ4Mvi0MeWIarHYKIArPpFr0bqvucDowQWaRaRz20Fy505g==',key_name='tempest-keypair-1045778721',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e5f8a6ca9ed41558cc68c4d1620674f',ramdisk_id='',reservation_id='r-650ebrlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1314827273',owner_user_name='tempest-VolumesSnapshotTestJSON-1314827273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecdf539ebf6a424c96f5703450da22fc',uuid=084b09fc-f359-4989-938d-c3caf5a870ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converting VIF {"id": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "address": "fa:16:3e:fc:77:32", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a0f485-77", "ovs_interfaceid": "69a0f485-7730-44c0-86bc-ca6e03b6198e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:77:32,bridge_name='br-int',has_traffic_filtering=True,id=69a0f485-7730-44c0-86bc-ca6e03b6198e,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a0f485-77') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG os_vif [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:77:32,bridge_name='br-int',has_traffic_filtering=True,id=69a0f485-7730-44c0-86bc-ca6e03b6198e,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a0f485-77') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69a0f485-77, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=519b63d5-32be-4751-9d30-f6c50fed623c) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:08 user nova-compute[74482]: INFO os_vif [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:77:32,bridge_name='br-int',has_traffic_filtering=True,id=69a0f485-7730-44c0-86bc-ca6e03b6198e,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a0f485-77')
Oct 23 23:49:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:3466c1a5-43c6-4d50-8c16-04e0ea4ce0c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zahYSulB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:49:08 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:49:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[994bb251-4e92-44e9-92d8-a787cf73ba79]: Unexpected error while running command.
Oct 23 23:49:08 user nova-compute[74482]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 23:49:08 user nova-compute[74482]: Exit code: 21
Oct 23 23:49:08 user nova-compute[74482]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 23:49:08 user nova-compute[74482]: Stderr: '' {{(pid=86306) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 23 23:49:08 user nova-compute[74482]: Traceback (most recent call last):
Oct 23 23:49:08 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 23 23:49:08 user nova-compute[74482]:     ret = func(*f_args, **f_kwargs)
Oct 23 23:49:08 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 23 23:49:08 user nova-compute[74482]:     return func(*args, **kwargs)
Oct 23 23:49:08 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 23 23:49:08 user nova-compute[74482]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 23 23:49:08 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 23 23:49:08 user nova-compute[74482]:     return putils.execute(on_execute=on_execute,
Oct 23 23:49:08 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 23 23:49:08 user nova-compute[74482]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 23 23:49:08 user nova-compute[74482]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 23:49:08 user nova-compute[74482]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 23:49:08 user nova-compute[74482]: Exit code: 21
Oct 23 23:49:08 user nova-compute[74482]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 23:49:08 user nova-compute[74482]: Stderr: ''
Oct 23 23:49:08 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[994bb251-4e92-44e9-92d8-a787cf73ba79]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 23:49:08 user nova-compute[74482]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 23:49:08 user nova-compute[74482]: Exit code: 21
Oct 23 23:49:08 user nova-compute[74482]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 23:49:08 user nova-compute[74482]: Stderr: ''
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 23 23:49:08 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi 
Oct 23 23:49:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74482) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] <== disconnect_volume: return (79ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:49:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Deleting instance files /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad_del
Oct 23 23:49:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Deletion of /opt/stack/data/nova/instances/084b09fc-f359-4989-938d-c3caf5a870ad_del complete
Oct 23 23:49:08 user nova-compute[74482]: INFO nova.compute.manager [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 23 23:49:08 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:49:08 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:49:09 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Took 1.14 seconds to deallocate network for instance.
Oct 23 23:49:09 user nova-compute[74482]: WARNING nova.volume.cinder [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Attachment bc9c2391-8708-490b-b7a1-0845979156ae does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bc9c2391-8708-490b-b7a1-0845979156ae. (HTTP 404) (Request-ID: req-9f513af0-819d-41bd-ba08-4c70acb85e8a)
Oct 23 23:49:09 user nova-compute[74482]: INFO nova.compute.manager [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Took 0.04 seconds to detach 1 volumes for instance.
Oct 23 23:49:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:49:09 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Deleted allocations for instance 084b09fc-f359-4989-938d-c3caf5a870ad
Oct 23 23:49:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-4ea9fd60-0317-4da2-8e93-2ca43dd06de8 req-2fada659-a20c-4e9c-88a5-eb915cbb3e82 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received event network-vif-plugged-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ea9fd60-0317-4da2-8e93-2ca43dd06de8 req-2fada659-a20c-4e9c-88a5-eb915cbb3e82 service nova] Acquiring lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ea9fd60-0317-4da2-8e93-2ca43dd06de8 req-2fada659-a20c-4e9c-88a5-eb915cbb3e82 service nova] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ea9fd60-0317-4da2-8e93-2ca43dd06de8 req-2fada659-a20c-4e9c-88a5-eb915cbb3e82 service nova] Lock "084b09fc-f359-4989-938d-c3caf5a870ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-4ea9fd60-0317-4da2-8e93-2ca43dd06de8 req-2fada659-a20c-4e9c-88a5-eb915cbb3e82 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] No waiting events found dispatching network-vif-plugged-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:49:09 user nova-compute[74482]: WARNING nova.compute.manager [req-4ea9fd60-0317-4da2-8e93-2ca43dd06de8 req-2fada659-a20c-4e9c-88a5-eb915cbb3e82 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received unexpected event network-vif-plugged-69a0f485-7730-44c0-86bc-ca6e03b6198e for instance with vm_state deleted and task_state None.
Oct 23 23:49:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-4ea9fd60-0317-4da2-8e93-2ca43dd06de8 req-2fada659-a20c-4e9c-88a5-eb915cbb3e82 service nova] [instance: 084b09fc-f359-4989-938d-c3caf5a870ad] Received event network-vif-deleted-69a0f485-7730-44c0-86bc-ca6e03b6198e {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:49:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1e0e8bec-86d2-4792-8b1a-bac63e472e23 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "084b09fc-f359-4989-938d-c3caf5a870ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.403s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:49:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:49:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:49:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:49:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:49:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:49:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:49:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:49:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:49:47 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:49:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:48 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:49:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:49:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:49:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:49:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:49:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:49:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:49:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:49:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:49:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:49:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:49:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:50:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:50:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:50:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:50:05 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:50:06 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:50:06 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:50:06 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9136MB free_disk=24.950634002685547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:50:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:50:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:50:06 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:50:06 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:50:06 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:50:06 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:50:06 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:50:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:50:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:50:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:50:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:50:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:50:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:50:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:50:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:50:17 user nova-compute[74482]: INFO nova.compute.claims [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Claim successful on node user
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:50:18 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:50:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.policy [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecdf539ebf6a424c96f5703450da22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e5f8a6ca9ed41558cc68c4d1620674f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:50:18 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Creating image(s)
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "/opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "/opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "/opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.175s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.171s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk 1073741824" returned: 0 in 0.057s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Successfully created port: 41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.183s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 23:50:18 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Cannot resize image /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Ensure instance console log exists: /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Successfully updated port: 41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquired lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.compute.manager [req-5c6e663e-415a-4ce3-8e6b-6bfeb72d866f req-7a0d0429-3c4f-4445-b7bf-1b15521751ec service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received event network-changed-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.compute.manager [req-5c6e663e-415a-4ce3-8e6b-6bfeb72d866f req-7a0d0429-3c4f-4445-b7bf-1b15521751ec service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Refreshing instance network info cache due to event network-changed-41b04849-f37d-47cb-9f71-3501fd0f51c7. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5c6e663e-415a-4ce3-8e6b-6bfeb72d866f req-7a0d0429-3c4f-4445-b7bf-1b15521751ec service nova] Acquiring lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updating instance_info_cache with network_info: [{"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Releasing lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Instance network_info: |[{"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5c6e663e-415a-4ce3-8e6b-6bfeb72d866f req-7a0d0429-3c4f-4445-b7bf-1b15521751ec service nova] Acquired lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.network.neutron [req-5c6e663e-415a-4ce3-8e6b-6bfeb72d866f req-7a0d0429-3c4f-4445-b7bf-1b15521751ec service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Refreshing network info cache for port 41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Start _get_guest_xml network_info=[{"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:50:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:50:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1330457661',display_name='tempest-VolumesSnapshotTestJSON-instance-1330457661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1330457661',id=46,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa78UVzyTJe//GxfXFv2rZIMfkfxqUmalpTbsjsFszCt+APALkQC62z5VD6Que71OoV3v09SYuMqUpuZQ4n2eRSt5dtR/8HUojFD+lw5CEc87S/8UXkdRrTc839H2TVqQ==',key_name='tempest-keypair-698533786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e5f8a6ca9ed41558cc68c4d1620674f',ramdisk_id='',reservation_id='r-gq2b359y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1314827273',owner_user_name='tempest-VolumesSnapshotTestJSON-1314827273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecdf539ebf6a424c96f5703450da22fc',uuid=b642fd4a-2258-4372-99f8-9a5f8973f120,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converting VIF {"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b3:7c,bridge_name='br-int',has_traffic_filtering=True,id=41b04849-f37d-47cb-9f71-3501fd0f51c7,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b04849-f3') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.objects.instance [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'pci_devices' on Instance uuid b642fd4a-2258-4372-99f8-9a5f8973f120 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:50:19 user nova-compute[74482]:   <uuid>b642fd4a-2258-4372-99f8-9a5f8973f120</uuid>
Oct 23 23:50:19 user nova-compute[74482]:   <name>instance-0000002e</name>
Oct 23 23:50:19 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:50:19 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:50:19 user nova-compute[74482]:   <metadata>
Oct 23 23:50:19 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:50:19 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:50:19 user nova-compute[74482]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1330457661</nova:name>
Oct 23 23:50:19 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:50:19</nova:creationTime>
Oct 23 23:50:19 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:50:19 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:50:19 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:50:19 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:50:19 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:50:19 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:50:19 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:50:19 user nova-compute[74482]:       <nova:owner>
Oct 23 23:50:19 user nova-compute[74482]:         <nova:user uuid="ecdf539ebf6a424c96f5703450da22fc">tempest-VolumesSnapshotTestJSON-1314827273-project-member</nova:user>
Oct 23 23:50:19 user nova-compute[74482]:         <nova:project uuid="5e5f8a6ca9ed41558cc68c4d1620674f">tempest-VolumesSnapshotTestJSON-1314827273</nova:project>
Oct 23 23:50:19 user nova-compute[74482]:       </nova:owner>
Oct 23 23:50:19 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 23 23:50:19 user nova-compute[74482]:       <nova:ports>
Oct 23 23:50:19 user nova-compute[74482]:         <nova:port uuid="41b04849-f37d-47cb-9f71-3501fd0f51c7">
Oct 23 23:50:19 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 23:50:19 user nova-compute[74482]:         </nova:port>
Oct 23 23:50:19 user nova-compute[74482]:       </nova:ports>
Oct 23 23:50:19 user nova-compute[74482]:     </nova:instance>
Oct 23 23:50:19 user nova-compute[74482]:   </metadata>
Oct 23 23:50:19 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:50:19 user nova-compute[74482]:     <system>
Oct 23 23:50:19 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:50:19 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:50:19 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:50:19 user nova-compute[74482]:       <entry name="serial">b642fd4a-2258-4372-99f8-9a5f8973f120</entry>
Oct 23 23:50:19 user nova-compute[74482]:       <entry name="uuid">b642fd4a-2258-4372-99f8-9a5f8973f120</entry>
Oct 23 23:50:19 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:50:19 user nova-compute[74482]:     </system>
Oct 23 23:50:19 user nova-compute[74482]:   </sysinfo>
Oct 23 23:50:19 user nova-compute[74482]:   <os>
Oct 23 23:50:19 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:50:19 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:50:19 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:50:19 user nova-compute[74482]:   </os>
Oct 23 23:50:19 user nova-compute[74482]:   <features>
Oct 23 23:50:19 user nova-compute[74482]:     <acpi/>
Oct 23 23:50:19 user nova-compute[74482]:     <apic/>
Oct 23 23:50:19 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:50:19 user nova-compute[74482]:   </features>
Oct 23 23:50:19 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:50:19 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:50:19 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:50:19 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:50:19 user nova-compute[74482]:   </clock>
Oct 23 23:50:19 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:50:19 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:50:19 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:50:19 user nova-compute[74482]:   </cpu>
Oct 23 23:50:19 user nova-compute[74482]:   <devices>
Oct 23 23:50:19 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 23 23:50:19 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 23:50:19 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk"/>
Oct 23 23:50:19 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:50:19 user nova-compute[74482]:     </disk>
Oct 23 23:50:19 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:50:19 user nova-compute[74482]:       <mac address="fa:16:3e:02:b3:7c"/>
Oct 23 23:50:19 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:50:19 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:50:19 user nova-compute[74482]:       <target dev="tap41b04849-f3"/>
Oct 23 23:50:19 user nova-compute[74482]:     </interface>
Oct 23 23:50:19 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:50:19 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/console.log" append="off"/>
Oct 23 23:50:19 user nova-compute[74482]:     </serial>
Oct 23 23:50:19 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:50:19 user nova-compute[74482]:     <video>
Oct 23 23:50:19 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:50:19 user nova-compute[74482]:     </video>
Oct 23 23:50:19 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:50:19 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:50:19 user nova-compute[74482]:     </rng>
Oct 23 23:50:19 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:50:19 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:50:19 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:50:19 user nova-compute[74482]:     </memballoon>
Oct 23 23:50:19 user nova-compute[74482]:   </devices>
Oct 23 23:50:19 user nova-compute[74482]: </domain>
Oct 23 23:50:19 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1330457661',display_name='tempest-VolumesSnapshotTestJSON-instance-1330457661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1330457661',id=46,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa78UVzyTJe//GxfXFv2rZIMfkfxqUmalpTbsjsFszCt+APALkQC62z5VD6Que71OoV3v09SYuMqUpuZQ4n2eRSt5dtR/8HUojFD+lw5CEc87S/8UXkdRrTc839H2TVqQ==',key_name='tempest-keypair-698533786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e5f8a6ca9ed41558cc68c4d1620674f',ramdisk_id='',reservation_id='r-gq2b359y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1314827273',owner_user_name='tempest-VolumesSnapshotTestJSON-1314827273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:50:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecdf539ebf6a424c96f5703450da22fc',uuid=b642fd4a-2258-4372-99f8-9a5f8973f120,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converting VIF {"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:b3:7c,bridge_name='br-int',has_traffic_filtering=True,id=41b04849-f37d-47cb-9f71-3501fd0f51c7,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b04849-f3') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG os_vif [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b3:7c,bridge_name='br-int',has_traffic_filtering=True,id=41b04849-f37d-47cb-9f71-3501fd0f51c7,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b04849-f3') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3bdcf0a-d08f-59cb-8ceb-59658ae72c3e', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41b04849-f3, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41b04849-f3, col_values=(('qos', UUID('eca03f46-e10f-4040-b0c1-21fe4450dd3a')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41b04849-f3, col_values=(('external_ids', {'iface-id': '41b04849-f37d-47cb-9f71-3501fd0f51c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:b3:7c', 'vm-uuid': 'b642fd4a-2258-4372-99f8-9a5f8973f120'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:19 user nova-compute[74482]: INFO os_vif [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:b3:7c,bridge_name='br-int',has_traffic_filtering=True,id=41b04849-f37d-47cb-9f71-3501fd0f51c7,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b04849-f3')
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:50:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No VIF found with MAC fa:16:3e:02:b3:7c, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:50:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-5c6e663e-415a-4ce3-8e6b-6bfeb72d866f req-7a0d0429-3c4f-4445-b7bf-1b15521751ec service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updated VIF entry in instance network info cache for port 41b04849-f37d-47cb-9f71-3501fd0f51c7. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:50:20 user nova-compute[74482]: DEBUG nova.network.neutron [req-5c6e663e-415a-4ce3-8e6b-6bfeb72d866f req-7a0d0429-3c4f-4445-b7bf-1b15521751ec service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updating instance_info_cache with network_info: [{"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:50:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5c6e663e-415a-4ce3-8e6b-6bfeb72d866f req-7a0d0429-3c4f-4445-b7bf-1b15521751ec service nova] Releasing lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-9dc61bf9-c289-4c01-a369-9266f6767958 req-ae44176d-c63e-44a3-9ffe-3944b3cbf958 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received event network-vif-plugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9dc61bf9-c289-4c01-a369-9266f6767958 req-ae44176d-c63e-44a3-9ffe-3944b3cbf958 service nova] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9dc61bf9-c289-4c01-a369-9266f6767958 req-ae44176d-c63e-44a3-9ffe-3944b3cbf958 service nova] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-9dc61bf9-c289-4c01-a369-9266f6767958 req-ae44176d-c63e-44a3-9ffe-3944b3cbf958 service nova] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG nova.compute.manager [req-9dc61bf9-c289-4c01-a369-9266f6767958 req-ae44176d-c63e-44a3-9ffe-3944b3cbf958 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] No waiting events found dispatching network-vif-plugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:50:21 user nova-compute[74482]: WARNING nova.compute.manager [req-9dc61bf9-c289-4c01-a369-9266f6767958 req-ae44176d-c63e-44a3-9ffe-3944b3cbf958 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received unexpected event network-vif-plugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 for instance with vm_state building and task_state spawning.
Oct 23 23:50:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:50:23 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Instance spawned successfully.
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-6ee9a1d6-d00f-4e67-a969-09295c6620e0 req-0bc0c323-e1dc-48d7-ad93-8161587e8a90 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received event network-vif-plugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6ee9a1d6-d00f-4e67-a969-09295c6620e0 req-0bc0c323-e1dc-48d7-ad93-8161587e8a90 service nova] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6ee9a1d6-d00f-4e67-a969-09295c6620e0 req-0bc0c323-e1dc-48d7-ad93-8161587e8a90 service nova] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6ee9a1d6-d00f-4e67-a969-09295c6620e0 req-0bc0c323-e1dc-48d7-ad93-8161587e8a90 service nova] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.compute.manager [req-6ee9a1d6-d00f-4e67-a969-09295c6620e0 req-0bc0c323-e1dc-48d7-ad93-8161587e8a90 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] No waiting events found dispatching network-vif-plugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:50:23 user nova-compute[74482]: WARNING nova.compute.manager [req-6ee9a1d6-d00f-4e67-a969-09295c6620e0 req-0bc0c323-e1dc-48d7-ad93-8161587e8a90 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received unexpected event network-vif-plugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 for instance with vm_state building and task_state spawning.
Oct 23 23:50:23 user nova-compute[74482]: INFO nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Took 5.12 seconds to spawn the instance on the hypervisor.
Oct 23 23:50:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:50:23 user nova-compute[74482]: INFO nova.compute.manager [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Took 5.66 seconds to build instance.
Oct 23 23:50:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-1a40534b-581e-4542-aa31-b2704b3afc53 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.751s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:50:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:50:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:50:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:50:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:50:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:50:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid b642fd4a-2258-4372-99f8-9a5f8973f120 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:50:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:50 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updating instance_info_cache with network_info: [{"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:50:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:50:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:50:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:50:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:54 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:50:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:50:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:50:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:50:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:50:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:50:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:50:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:51:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:51:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:51:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:51:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:51:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:51:06 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:51:06 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:51:07 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:51:07 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=24.920997619628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance b642fd4a-2258-4372-99f8-9a5f8973f120 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:51:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:51:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:51:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:51:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:51:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:51:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:51:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:51:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:51:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:51:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:51:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:51:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid b642fd4a-2258-4372-99f8-9a5f8973f120 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:51:50 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updating instance_info_cache with network_info: [{"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:51:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:51:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:51:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:51:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:51:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:51:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:51:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:51:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:52:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:52:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-108f9c51-7948-44a2-9140-b36ce806cfb2 req-de0d79e0-3a08-4751-bb18-ecea92b67215 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received event network-changed-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-108f9c51-7948-44a2-9140-b36ce806cfb2 req-de0d79e0-3a08-4751-bb18-ecea92b67215 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Refreshing instance network info cache due to event network-changed-41b04849-f37d-47cb-9f71-3501fd0f51c7. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-108f9c51-7948-44a2-9140-b36ce806cfb2 req-de0d79e0-3a08-4751-bb18-ecea92b67215 service nova] Acquiring lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-108f9c51-7948-44a2-9140-b36ce806cfb2 req-de0d79e0-3a08-4751-bb18-ecea92b67215 service nova] Acquired lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG nova.network.neutron [req-108f9c51-7948-44a2-9140-b36ce806cfb2 req-de0d79e0-3a08-4751-bb18-ecea92b67215 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Refreshing network info cache for port 41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:08 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:09 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:52:09 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:52:09 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=24.92040252685547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-108f9c51-7948-44a2-9140-b36ce806cfb2 req-de0d79e0-3a08-4751-bb18-ecea92b67215 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updated VIF entry in instance network info cache for port 41b04849-f37d-47cb-9f71-3501fd0f51c7. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG nova.network.neutron [req-108f9c51-7948-44a2-9140-b36ce806cfb2 req-de0d79e0-3a08-4751-bb18-ecea92b67215 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updating instance_info_cache with network_info: [{"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-108f9c51-7948-44a2-9140-b36ce806cfb2 req-de0d79e0-3a08-4751-bb18-ecea92b67215 service nova] Releasing lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance b642fd4a-2258-4372-99f8-9a5f8973f120 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'flavor' on Instance uuid b642fd4a-2258-4372-99f8-9a5f8973f120 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:52:10 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Ignoring supplied device name: /dev/vdb
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:52:10 user nova-compute[74482]: INFO nova.compute.manager [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Attaching volume e014abf7-86e0-4398-8dcc-a6d0089f27ba to /dev/vdb
Oct 23 23:52:10 user nova-compute[74482]: DEBUG os_brick.utils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[556f3816-1f73-4156-ba0f-9822a6b1072a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a82b6fe-641b-403c-86a8-0ae3559b7a3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd31c43-9dba-40d1-b43b-822c9dfe8098]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a0e7a2-a645-472b-87ec-aa3eb737567f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:52:10 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:52:10 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a5c63c-9b9a-4086-bcc2-9bec93d34fb6]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG os_brick.utils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] <== get_connector_properties: return (267ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:52:10 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updating existing volume attachment record: fc670112-b297-4d09-a516-6ff24b5c83ac {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:52:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycPmxNGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:52:26 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:52:26 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:52:26 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cd57f9-9f69-4703-8762-c9ba8f198078]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:52:26 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[85300a32-31de-42f2-8475-a875c55ad8c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba] added
Oct 23 23:52:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c130033-432c-4082-8485-3e4a79a5c776]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[40539df1-dd9f-4107-9336-f3bfc541ffdc]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycPmxNGH {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycPmxNGH" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff080a5-a4a3-4235-9cf5-ec3ab68d3c46]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycPmxNGH'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d42c3a8-76c7-41ca-b0e2-85ebdea6368d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf886d2-8037-4b6b-90b5-09143b873241]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:52:26 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:52:26 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:52:26 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:52:26 user nova-compute[74482]: 
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0055a8b7-9352-42e2-8993-b385264d1644]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba, portal: 172.16.0.220,3260]
Oct 23 23:52:26 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba, portal: 172.16.0.220,3260] successful.
Oct 23 23:52:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8daac5-1d91-4635-9c09-0c244d68ccdc]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfd133b-4d61-4d46-a077-d386d2650636]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba (non-flash)
Oct 23 23:52:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba (non-flash)
Oct 23 23:52:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1195117d-3403-4831-bc23-4642b5325698]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:52:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycPmxNGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:52:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:52:27 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23666303563303161', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:52:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666303563303161', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:52:27 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'flavor' on Instance uuid b642fd4a-2258-4372-99f8-9a5f8973f120 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:52:27 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 23:52:27 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:52:27 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:52:27 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:52:27 user nova-compute[74482]:   <serial>e014abf7-86e0-4398-8dcc-a6d0089f27ba</serial>
Oct 23 23:52:27 user nova-compute[74482]: </disk>
Oct 23 23:52:27 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 23:52:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:52:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:52:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] No VIF found with MAC fa:16:3e:02:b3:7c, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:52:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a8f27888-97bd-477a-8019-02ab1932eee6 tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:52:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:52:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:52:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:52:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:52:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:52:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:52:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:52:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:52:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:52:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:52:51 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid b642fd4a-2258-4372-99f8-9a5f8973f120 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:52:52 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updating instance_info_cache with network_info: [{"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:52:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-b642fd4a-2258-4372-99f8-9a5f8973f120" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:52:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:52:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:52:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:52:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:52:53 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:52:53 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:52:54 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:52:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:52:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:52:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:52:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:52:56 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:53:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:53:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:53:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:53:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:10 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:53:11 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:53:11 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:53:11 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=24.91919708251953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance b642fd4a-2258-4372-99f8-9a5f8973f120 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:53:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:53:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:53:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:53:16 user nova-compute[74482]: INFO nova.compute.manager [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Detaching volume e014abf7-86e0-4398-8dcc-a6d0089f27ba
Oct 23 23:53:16 user nova-compute[74482]: INFO nova.virt.block_device [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Attempting to driver detach volume e014abf7-86e0-4398-8dcc-a6d0089f27ba from mountpoint /dev/vdb
Oct 23 23:53:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Attempting to detach device vdb from instance b642fd4a-2258-4372-99f8-9a5f8973f120 from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 23:53:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:53:16 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:53:16 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:53:16 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:53:16 user nova-compute[74482]:   <serial>e014abf7-86e0-4398-8dcc-a6d0089f27ba</serial>
Oct 23 23:53:16 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:53:16 user nova-compute[74482]: </disk>
Oct 23 23:53:16 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:53:16 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Successfully detached device vdb from instance b642fd4a-2258-4372-99f8-9a5f8973f120 from the persistent domain config.
Oct 23 23:53:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b642fd4a-2258-4372-99f8-9a5f8973f120 from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 23:53:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 23:53:16 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:53:16 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 23 23:53:16 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 23 23:53:16 user nova-compute[74482]:   <serial>e014abf7-86e0-4398-8dcc-a6d0089f27ba</serial>
Oct 23 23:53:16 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 23:53:16 user nova-compute[74482]: </disk>
Oct 23 23:53:16 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 23:53:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:53:16 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b642fd4a-2258-4372-99f8-9a5f8973f120 {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 23:53:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b642fd4a-2258-4372-99f8-9a5f8973f120 is timed out.
Oct 23 23:53:36 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Successfully detached device vdb from instance b642fd4a-2258-4372-99f8-9a5f8973f120 from the live domain config.
Oct 23 23:53:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycPmxNGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:53:36 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[045e0396-09c8-48d7-988c-6c701d198108]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:53:36 user nova-compute[74482]: No targets found.
Oct 23 23:53:36 user nova-compute[74482]: iSNS:
Oct 23 23:53:36 user nova-compute[74482]: No targets found.
Oct 23 23:53:36 user nova-compute[74482]: STATIC:
Oct 23 23:53:36 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba
Oct 23 23:53:36 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:53:36 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:53:36 user nova-compute[74482]: FIRMWARE:
Oct 23 23:53:36 user nova-compute[74482]: No targets found.
Oct 23 23:53:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:53:36 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:53:36 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[902bf0db-6606-4470-b505-9b39ab1df7cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded19c91-b4f0-43f2-8d62-bf1b00af9b57]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba (non-flash)
Oct 23 23:53:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba (non-flash)
Oct 23 23:53:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c443eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acd75c6-c231-4807-8768-e4134ab573bd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f091f07-6807-4654-a211-80b569cb4252]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca144d-af65-4c8c-8002-04e62a81a3d9]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6059bc33-9bbc-4a70-a843-3ee2358c59bd]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec955e91-a8ce-4068-a30c-8084189761c8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4169dc8-4416-4590-bcd2-661f1560b712]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba, portal: 172.16.0.220,3260]
Oct 23 23:53:36 user nova-compute[74482]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba, portal: 172.16.0.220,3260] successful.
Oct 23 23:53:36 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8044f9d3-2f2b-4a65-a0d9-538b86a5dd60]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] <== disconnect_volume: return (288ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:53:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'flavor' on Instance uuid b642fd4a-2258-4372-99f8-9a5f8973f120 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7d187215-a7c7-4b31-9b34-04f0777a874d tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.747s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.607s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:53:37 user nova-compute[74482]: INFO nova.compute.manager [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Terminating instance
Oct 23 23:53:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a558f4a-bc60-42e7-a4d4-b6db59653f4e req-f6ff62ef-5df7-416b-a8fa-0e2758ba672e service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received event network-vif-unplugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a558f4a-bc60-42e7-a4d4-b6db59653f4e req-f6ff62ef-5df7-416b-a8fa-0e2758ba672e service nova] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a558f4a-bc60-42e7-a4d4-b6db59653f4e req-f6ff62ef-5df7-416b-a8fa-0e2758ba672e service nova] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2a558f4a-bc60-42e7-a4d4-b6db59653f4e req-f6ff62ef-5df7-416b-a8fa-0e2758ba672e service nova] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a558f4a-bc60-42e7-a4d4-b6db59653f4e req-f6ff62ef-5df7-416b-a8fa-0e2758ba672e service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] No waiting events found dispatching network-vif-unplugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-2a558f4a-bc60-42e7-a4d4-b6db59653f4e req-f6ff62ef-5df7-416b-a8fa-0e2758ba672e service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received event network-vif-unplugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Instance destroyed successfully.
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.objects.instance [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lazy-loading 'resources' on Instance uuid b642fd4a-2258-4372-99f8-9a5f8973f120 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1330457661',display_name='tempest-VolumesSnapshotTestJSON-instance-1330457661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1330457661',id=46,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa78UVzyTJe//GxfXFv2rZIMfkfxqUmalpTbsjsFszCt+APALkQC62z5VD6Que71OoV3v09SYuMqUpuZQ4n2eRSt5dtR/8HUojFD+lw5CEc87S/8UXkdRrTc839H2TVqQ==',key_name='tempest-keypair-698533786',keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:50:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e5f8a6ca9ed41558cc68c4d1620674f',ramdisk_id='',reservation_id='r-gq2b359y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1314827273',owner_user_name='tempest-VolumesSnapshotTestJSON-1314827273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:50:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecdf539ebf6a424c96f5703450da22fc',uuid=b642fd4a-2258-4372-99f8-9a5f8973f120,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converting VIF {"id": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "address": "fa:16:3e:02:b3:7c", "network": {"id": "3551d7aa-b32c-4c01-9600-c6f3d31e6107", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-562611579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e5f8a6ca9ed41558cc68c4d1620674f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41b04849-f3", "ovs_interfaceid": "41b04849-f37d-47cb-9f71-3501fd0f51c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:b3:7c,bridge_name='br-int',has_traffic_filtering=True,id=41b04849-f37d-47cb-9f71-3501fd0f51c7,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b04849-f3') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG os_vif [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:b3:7c,bridge_name='br-int',has_traffic_filtering=True,id=41b04849-f37d-47cb-9f71-3501fd0f51c7,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b04849-f3') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41b04849-f3, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eca03f46-e10f-4040-b0c1-21fe4450dd3a) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:38 user nova-compute[74482]: INFO os_vif [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:b3:7c,bridge_name='br-int',has_traffic_filtering=True,id=41b04849-f37d-47cb-9f71-3501fd0f51c7,network=Network(3551d7aa-b32c-4c01-9600-c6f3d31e6107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41b04849-f3')
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:e014abf7-86e0-4398-8dcc-a6d0089f27ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycPmxNGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:53:38 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:53:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[ee35412c-4499-4cef-ab2a-11f2d1852f82]: Unexpected error while running command.
Oct 23 23:53:38 user nova-compute[74482]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 23:53:38 user nova-compute[74482]: Exit code: 21
Oct 23 23:53:38 user nova-compute[74482]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 23:53:38 user nova-compute[74482]: Stderr: '' {{(pid=86306) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 23 23:53:38 user nova-compute[74482]: Traceback (most recent call last):
Oct 23 23:53:38 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 23 23:53:38 user nova-compute[74482]:     ret = func(*f_args, **f_kwargs)
Oct 23 23:53:38 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 23 23:53:38 user nova-compute[74482]:     return func(*args, **kwargs)
Oct 23 23:53:38 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 23 23:53:38 user nova-compute[74482]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 23 23:53:38 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 23 23:53:38 user nova-compute[74482]:     return putils.execute(on_execute=on_execute,
Oct 23 23:53:38 user nova-compute[74482]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 23 23:53:38 user nova-compute[74482]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 23 23:53:38 user nova-compute[74482]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 23:53:38 user nova-compute[74482]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 23:53:38 user nova-compute[74482]: Exit code: 21
Oct 23 23:53:38 user nova-compute[74482]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 23:53:38 user nova-compute[74482]: Stderr: ''
Oct 23 23:53:38 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee35412c-4499-4cef-ab2a-11f2d1852f82]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 23:53:38 user nova-compute[74482]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 23:53:38 user nova-compute[74482]: Exit code: 21
Oct 23 23:53:38 user nova-compute[74482]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 23:53:38 user nova-compute[74482]: Stderr: ''
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 23 23:53:38 user nova-compute[74482]: ERROR os_brick.initiator.connectors.iscsi 
Oct 23 23:53:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74482) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] <== disconnect_volume: return (29ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:53:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Deleting instance files /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120_del
Oct 23 23:53:38 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Deletion of /opt/stack/data/nova/instances/b642fd4a-2258-4372-99f8-9a5f8973f120_del complete
Oct 23 23:53:38 user nova-compute[74482]: INFO nova.compute.manager [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 23 23:53:38 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:53:38 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:53:39 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:53:39 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Took 0.80 seconds to deallocate network for instance.
Oct 23 23:53:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-4a5e89e4-9169-4ba3-aa87-e848d40003c4 req-6a833f2d-0bce-4eb7-b150-d5a1166f36c1 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received event network-vif-deleted-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:53:39 user nova-compute[74482]: WARNING nova.volume.cinder [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Attachment fc670112-b297-4d09-a516-6ff24b5c83ac does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fc670112-b297-4d09-a516-6ff24b5c83ac. (HTTP 404) (Request-ID: req-215fcdaf-f0da-43bb-9209-fe366ed73f31)
Oct 23 23:53:39 user nova-compute[74482]: INFO nova.compute.manager [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Took 0.03 seconds to detach 1 volumes for instance.
Oct 23 23:53:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:53:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:53:39 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:53:39 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:53:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:53:39 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Deleted allocations for instance b642fd4a-2258-4372-99f8-9a5f8973f120
Oct 23 23:53:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91428306-a871-4208-826c-a46d31cc908f tempest-VolumesSnapshotTestJSON-1314827273 tempest-VolumesSnapshotTestJSON-1314827273-project-member] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:53:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-64980dc8-ff8e-4034-8473-68d3ccf3b7cf req-22eae32c-686b-40f1-b573-0a5e0ccfa918 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received event network-vif-plugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:53:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-64980dc8-ff8e-4034-8473-68d3ccf3b7cf req-22eae32c-686b-40f1-b573-0a5e0ccfa918 service nova] Acquiring lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:53:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-64980dc8-ff8e-4034-8473-68d3ccf3b7cf req-22eae32c-686b-40f1-b573-0a5e0ccfa918 service nova] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:53:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-64980dc8-ff8e-4034-8473-68d3ccf3b7cf req-22eae32c-686b-40f1-b573-0a5e0ccfa918 service nova] Lock "b642fd4a-2258-4372-99f8-9a5f8973f120-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:53:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-64980dc8-ff8e-4034-8473-68d3ccf3b7cf req-22eae32c-686b-40f1-b573-0a5e0ccfa918 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] No waiting events found dispatching network-vif-plugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:53:40 user nova-compute[74482]: WARNING nova.compute.manager [req-64980dc8-ff8e-4034-8473-68d3ccf3b7cf req-22eae32c-686b-40f1-b573-0a5e0ccfa918 service nova] [instance: b642fd4a-2258-4372-99f8-9a5f8973f120] Received unexpected event network-vif-plugged-41b04849-f37d-47cb-9f71-3501fd0f51c7 for instance with vm_state deleted and task_state None.
Oct 23 23:53:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:53:51 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:53:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:53:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:53:54 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:53:54 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:53:54 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:53:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:53:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:53:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:54:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:11 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:54:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:54:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:54:11 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:54:12 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:54:12 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:54:12 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9114MB free_disk=24.938182830810547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:54:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:54:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:54:12 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:54:12 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:54:12 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:54:12 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:54:12 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:54:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:54:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:54:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:54:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:54:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:54:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:54:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:54:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:54:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:54:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:54:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:54:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:54:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:54:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:54:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:54:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:56 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:54:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:55:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:55:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:55:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:55:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:55:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:11 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:55:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:55:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:55:11 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:55:11 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:55:12 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:55:12 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:55:12 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9129MB free_disk=24.936908721923828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:55:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:55:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:55:12 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:55:12 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:55:12 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:55:12 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:55:12 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:55:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:55:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:55:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:55:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:55:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:55:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:55:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:53 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:55:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:53 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:55:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:55:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:55:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:55:53 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:55:53 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:55:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:55:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:55:56 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:55:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:55:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:55:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 23:56:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 23:56:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 23:56:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:56:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:56:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:56:12 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:56:13 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:56:13 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=24.934791564941406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:56:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_power_states {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:56:34 user nova-compute[74482]: INFO nova.compute.claims [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Claim successful on node user
Oct 23 23:56:34 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:56:34 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:56:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:56:34 user nova-compute[74482]: INFO nova.virt.block_device [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Booting with volume snapshot 4c6ee223-0711-4797-8cba-e0086c59676e at /dev/vda
Oct 23 23:56:34 user nova-compute[74482]: DEBUG nova.policy [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7adbba189645ecb67794b738c87db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1bcbe0d3b94e158cc20c6905b80f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:56:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Successfully created port: 4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:56:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Successfully updated port: 4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:56:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "refresh_cache-f9d55049-d57d-44b9-92c9-c75a02d2a30c" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:56:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquired lock "refresh_cache-f9d55049-d57d-44b9-92c9-c75a02d2a30c" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:56:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:56:35 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:56:35 user nova-compute[74482]: DEBUG nova.compute.manager [req-adb2b5f0-6ffa-4fb3-835f-836a71606022 req-4bf64d6e-d4ef-464e-83d5-ca21a6b4f4ca service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received event network-changed-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:56:35 user nova-compute[74482]: DEBUG nova.compute.manager [req-adb2b5f0-6ffa-4fb3-835f-836a71606022 req-4bf64d6e-d4ef-464e-83d5-ca21a6b4f4ca service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Refreshing instance network info cache due to event network-changed-4bf48c5f-1a28-4409-90fc-2fe8339dc835. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:56:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-adb2b5f0-6ffa-4fb3-835f-836a71606022 req-4bf64d6e-d4ef-464e-83d5-ca21a6b4f4ca service nova] Acquiring lock "refresh_cache-f9d55049-d57d-44b9-92c9-c75a02d2a30c" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:56:36 user nova-compute[74482]: DEBUG nova.network.neutron [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Updating instance_info_cache with network_info: [{"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:56:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Releasing lock "refresh_cache-f9d55049-d57d-44b9-92c9-c75a02d2a30c" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:56:36 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Instance network_info: |[{"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:56:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-adb2b5f0-6ffa-4fb3-835f-836a71606022 req-4bf64d6e-d4ef-464e-83d5-ca21a6b4f4ca service nova] Acquired lock "refresh_cache-f9d55049-d57d-44b9-92c9-c75a02d2a30c" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:56:36 user nova-compute[74482]: DEBUG nova.network.neutron [req-adb2b5f0-6ffa-4fb3-835f-836a71606022 req-4bf64d6e-d4ef-464e-83d5-ca21a6b4f4ca service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Refreshing network info cache for port 4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:56:36 user nova-compute[74482]: DEBUG nova.network.neutron [req-adb2b5f0-6ffa-4fb3-835f-836a71606022 req-4bf64d6e-d4ef-464e-83d5-ca21a6b4f4ca service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Updated VIF entry in instance network info cache for port 4bf48c5f-1a28-4409-90fc-2fe8339dc835. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:56:36 user nova-compute[74482]: DEBUG nova.network.neutron [req-adb2b5f0-6ffa-4fb3-835f-836a71606022 req-4bf64d6e-d4ef-464e-83d5-ca21a6b4f4ca service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Updating instance_info_cache with network_info: [{"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:56:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-adb2b5f0-6ffa-4fb3-835f-836a71606022 req-4bf64d6e-d4ef-464e-83d5-ca21a6b4f4ca service nova] Releasing lock "refresh_cache-f9d55049-d57d-44b9-92c9-c75a02d2a30c" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:56:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG os_brick.utils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[120449fb-e572-4657-887b-59e1a5f9dc1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[411cb738-0d1a-41c8-a26f-cc8db6b9239b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[727b19b0-26c7-4d4d-861e-d1bfd8ec7761]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed04629-5849-4321-a678-898978dbd740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:56:40 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:56:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce8fd7c-46b6-42af-a552-e71804e6462c]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG os_brick.utils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:56:40 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Updating existing volume attachment record: c69169bb-9b99-406e-9a61-6eae7546cb52 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:56:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:56:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:56:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:56:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:56:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:53 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:54 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:56:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:56:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Skipping network cache update for instance because it is Building. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 23:56:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:56:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 23:56:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Creating image(s)
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Ensure instance console log exists: /opt/stack/data/nova/instances/f9d55049-d57d-44b9-92c9-c75a02d2a30c/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Start _get_guest_xml network_info=[{"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTuiLRsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9d55049-d57d-44b9-92c9-c75a02d2a30c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c66adf6e-eff2-404a-8509-9a0728201e66', 'serial': 'c66adf6e-eff2-404a-8509-9a0728201e66'}, 'disk_bus': 'virtio', 'attachment_id': 'c69169bb-9b99-406e-9a61-6eae7546cb52', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 23:56:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:56:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTuiLRsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:56:56 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:56:56 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:56:56 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf06bf6-d829-46b9-9cb1-b73c241aae30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 23:56:56 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f1e7a-86c9-4c2d-a8fc-8191b560f9ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66] added
Oct 23 23:56:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe401ae-972d-4820-86f2-e87ec1da4c93]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62ccdbf-e066-4125-aabd-a7f366a4dfca]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTuiLRsD {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTuiLRsD" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bdd859-eea9-49af-9f66-02b8db062f4a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTuiLRsD'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab9ab5-65ca-41c9-b30f-d51c2fbe5336]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2d6ac6-ccf8-4f23-b79f-8734942b14e6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:56:56 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 23:56:56 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:56:56 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 23:56:56 user nova-compute[74482]: 
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7029bf4b-48e9-4369-9fea-a4481140b7a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66, portal: 172.16.0.220,3260]
Oct 23 23:56:56 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66, portal: 172.16.0.220,3260] successful.
Oct 23 23:56:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5633594b-550d-4e9f-8a75-73d73ce94e63]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5139ee3-7d15-4062-91ac-a1789f820d38]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 (non-flash)
Oct 23 23:56:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 (non-flash)
Oct 23 23:56:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a747e-40ec-4322-a274-c5db73968bed]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTuiLRsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 23:56:56 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23239333561323634', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239333561323634', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-971700351',display_name='tempest-TestVolumeBootPattern-server-971700351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-971700351',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-ciyl0s09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:56:35Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=f9d55049-d57d-44b9-92c9-c75a02d2a30c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=4bf48c5f-1a28-4409-90fc-2fe8339dc835,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf48c5f-1a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.objects.instance [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'pci_devices' on Instance uuid f9d55049-d57d-44b9-92c9-c75a02d2a30c {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 23:56:57 user nova-compute[74482]:   <uuid>f9d55049-d57d-44b9-92c9-c75a02d2a30c</uuid>
Oct 23 23:56:57 user nova-compute[74482]:   <name>instance-0000002f</name>
Oct 23 23:56:57 user nova-compute[74482]:   <memory>524288</memory>
Oct 23 23:56:57 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 23 23:56:57 user nova-compute[74482]:   <metadata>
Oct 23 23:56:57 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 23:56:57 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 23 23:56:57 user nova-compute[74482]:       <nova:name>tempest-TestVolumeBootPattern-server-971700351</nova:name>
Oct 23 23:56:57 user nova-compute[74482]:       <nova:creationTime>2023-10-23 23:56:56</nova:creationTime>
Oct 23 23:56:57 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 23 23:56:57 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 23 23:56:57 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 23 23:56:57 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 23 23:56:57 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 23:56:57 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 23 23:56:57 user nova-compute[74482]:       </nova:flavor>
Oct 23 23:56:57 user nova-compute[74482]:       <nova:owner>
Oct 23 23:56:57 user nova-compute[74482]:         <nova:user uuid="ab7adbba189645ecb67794b738c87db1">tempest-TestVolumeBootPattern-334654437-project-member</nova:user>
Oct 23 23:56:57 user nova-compute[74482]:         <nova:project uuid="bd1bcbe0d3b94e158cc20c6905b80f13">tempest-TestVolumeBootPattern-334654437</nova:project>
Oct 23 23:56:57 user nova-compute[74482]:       </nova:owner>
Oct 23 23:56:57 user nova-compute[74482]:       <nova:ports>
Oct 23 23:56:57 user nova-compute[74482]:         <nova:port uuid="4bf48c5f-1a28-4409-90fc-2fe8339dc835">
Oct 23 23:56:57 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 23:56:57 user nova-compute[74482]:         </nova:port>
Oct 23 23:56:57 user nova-compute[74482]:       </nova:ports>
Oct 23 23:56:57 user nova-compute[74482]:     </nova:instance>
Oct 23 23:56:57 user nova-compute[74482]:   </metadata>
Oct 23 23:56:57 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 23 23:56:57 user nova-compute[74482]:     <system>
Oct 23 23:56:57 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 23:56:57 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 23 23:56:57 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 23 23:56:57 user nova-compute[74482]:       <entry name="serial">f9d55049-d57d-44b9-92c9-c75a02d2a30c</entry>
Oct 23 23:56:57 user nova-compute[74482]:       <entry name="uuid">f9d55049-d57d-44b9-92c9-c75a02d2a30c</entry>
Oct 23 23:56:57 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 23 23:56:57 user nova-compute[74482]:     </system>
Oct 23 23:56:57 user nova-compute[74482]:   </sysinfo>
Oct 23 23:56:57 user nova-compute[74482]:   <os>
Oct 23 23:56:57 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 23:56:57 user nova-compute[74482]:     <boot dev="hd"/>
Oct 23 23:56:57 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 23 23:56:57 user nova-compute[74482]:   </os>
Oct 23 23:56:57 user nova-compute[74482]:   <features>
Oct 23 23:56:57 user nova-compute[74482]:     <acpi/>
Oct 23 23:56:57 user nova-compute[74482]:     <apic/>
Oct 23 23:56:57 user nova-compute[74482]:     <vmcoreinfo/>
Oct 23 23:56:57 user nova-compute[74482]:   </features>
Oct 23 23:56:57 user nova-compute[74482]:   <clock offset="utc">
Oct 23 23:56:57 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 23:56:57 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 23:56:57 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 23 23:56:57 user nova-compute[74482]:   </clock>
Oct 23 23:56:57 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 23 23:56:57 user nova-compute[74482]:     <model>Nehalem</model>
Oct 23 23:56:57 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 23:56:57 user nova-compute[74482]:   </cpu>
Oct 23 23:56:57 user nova-compute[74482]:   <devices>
Oct 23 23:56:57 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 23 23:56:57 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 23:56:57 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 23 23:56:57 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 23 23:56:57 user nova-compute[74482]:       <serial>c66adf6e-eff2-404a-8509-9a0728201e66</serial>
Oct 23 23:56:57 user nova-compute[74482]:     </disk>
Oct 23 23:56:57 user nova-compute[74482]:     <interface type="ethernet">
Oct 23 23:56:57 user nova-compute[74482]:       <mac address="fa:16:3e:a9:00:6a"/>
Oct 23 23:56:57 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:56:57 user nova-compute[74482]:       <mtu size="1442"/>
Oct 23 23:56:57 user nova-compute[74482]:       <target dev="tap4bf48c5f-1a"/>
Oct 23 23:56:57 user nova-compute[74482]:     </interface>
Oct 23 23:56:57 user nova-compute[74482]:     <serial type="pty">
Oct 23 23:56:57 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/f9d55049-d57d-44b9-92c9-c75a02d2a30c/console.log" append="off"/>
Oct 23 23:56:57 user nova-compute[74482]:     </serial>
Oct 23 23:56:57 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 23:56:57 user nova-compute[74482]:     <video>
Oct 23 23:56:57 user nova-compute[74482]:       <model type="virtio"/>
Oct 23 23:56:57 user nova-compute[74482]:     </video>
Oct 23 23:56:57 user nova-compute[74482]:     <rng model="virtio">
Oct 23 23:56:57 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 23 23:56:57 user nova-compute[74482]:     </rng>
Oct 23 23:56:57 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 23 23:56:57 user nova-compute[74482]:     <memballoon model="virtio">
Oct 23 23:56:57 user nova-compute[74482]:       <stats period="10"/>
Oct 23 23:56:57 user nova-compute[74482]:     </memballoon>
Oct 23 23:56:57 user nova-compute[74482]:   </devices>
Oct 23 23:56:57 user nova-compute[74482]: </domain>
Oct 23 23:56:57 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-971700351',display_name='tempest-TestVolumeBootPattern-server-971700351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-971700351',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-ciyl0s09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:56:35Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=f9d55049-d57d-44b9-92c9-c75a02d2a30c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=4bf48c5f-1a28-4409-90fc-2fe8339dc835,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf48c5f-1a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG os_vif [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=4bf48c5f-1a28-4409-90fc-2fe8339dc835,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf48c5f-1a') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ae12803-8511-56fa-b3f9-d77b607ba22c', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bf48c5f-1a, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4bf48c5f-1a, col_values=(('qos', UUID('29e54774-9a83-4f96-9351-50a9a995ce73')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4bf48c5f-1a, col_values=(('external_ids', {'iface-id': '4bf48c5f-1a28-4409-90fc-2fe8339dc835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:00:6a', 'vm-uuid': 'f9d55049-d57d-44b9-92c9-c75a02d2a30c'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:57 user nova-compute[74482]: INFO os_vif [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=4bf48c5f-1a28-4409-90fc-2fe8339dc835,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf48c5f-1a')
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No VIF found with MAC fa:16:3e:a9:00:6a, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 23:56:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-0af7ff3e-8b85-41df-b520-072984b74364 req-dbb2db37-d629-4fd4-a3da-34d1ee521081 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received event network-vif-plugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:56:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0af7ff3e-8b85-41df-b520-072984b74364 req-dbb2db37-d629-4fd4-a3da-34d1ee521081 service nova] Acquiring lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:56:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0af7ff3e-8b85-41df-b520-072984b74364 req-dbb2db37-d629-4fd4-a3da-34d1ee521081 service nova] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:56:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0af7ff3e-8b85-41df-b520-072984b74364 req-dbb2db37-d629-4fd4-a3da-34d1ee521081 service nova] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:56:58 user nova-compute[74482]: DEBUG nova.compute.manager [req-0af7ff3e-8b85-41df-b520-072984b74364 req-dbb2db37-d629-4fd4-a3da-34d1ee521081 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] No waiting events found dispatching network-vif-plugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:56:58 user nova-compute[74482]: WARNING nova.compute.manager [req-0af7ff3e-8b85-41df-b520-072984b74364 req-dbb2db37-d629-4fd4-a3da-34d1ee521081 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received unexpected event network-vif-plugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 for instance with vm_state building and task_state spawning.
Oct 23 23:56:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:56:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:56:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 23:57:00 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Instance spawned successfully.
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 23:57:00 user nova-compute[74482]: INFO nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Took 4.88 seconds to spawn the instance on the hypervisor.
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-0a049e31-dc74-4583-be50-c7e44e063fb6 req-5e10435a-e0e9-457d-999b-f4d7f3829713 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received event network-vif-plugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0a049e31-dc74-4583-be50-c7e44e063fb6 req-5e10435a-e0e9-457d-999b-f4d7f3829713 service nova] Acquiring lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0a049e31-dc74-4583-be50-c7e44e063fb6 req-5e10435a-e0e9-457d-999b-f4d7f3829713 service nova] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0a049e31-dc74-4583-be50-c7e44e063fb6 req-5e10435a-e0e9-457d-999b-f4d7f3829713 service nova] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:57:00 user nova-compute[74482]: DEBUG nova.compute.manager [req-0a049e31-dc74-4583-be50-c7e44e063fb6 req-5e10435a-e0e9-457d-999b-f4d7f3829713 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] No waiting events found dispatching network-vif-plugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:57:00 user nova-compute[74482]: WARNING nova.compute.manager [req-0a049e31-dc74-4583-be50-c7e44e063fb6 req-5e10435a-e0e9-457d-999b-f4d7f3829713 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received unexpected event network-vif-plugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 for instance with vm_state building and task_state spawning.
Oct 23 23:57:01 user nova-compute[74482]: INFO nova.compute.manager [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Took 26.88 seconds to build instance.
Oct 23 23:57:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-bc6f8899-ee97-4cc5-a47b-27fccc878d4a tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.970s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:57:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:57:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:57:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:57:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:57:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:57:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:57:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:57:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:57:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:57:13 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:57:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:57:14 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:57:14 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:57:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=24.93286895751953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:57:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:57:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:57:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance f9d55049-d57d-44b9-92c9-c75a02d2a30c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:57:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:57:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:57:14 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:57:14 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:57:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:57:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:57:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:57:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:57:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:57:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:57:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:57:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:57:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:57:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:57:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:57:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:57:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:57:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:57:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:57:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:57:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:57:55 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:57:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:57:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:57:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-f9d55049-d57d-44b9-92c9-c75a02d2a30c" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:57:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-f9d55049-d57d-44b9-92c9-c75a02d2a30c" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:57:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 23:57:55 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid f9d55049-d57d-44b9-92c9-c75a02d2a30c {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:57:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Updating instance_info_cache with network_info: [{"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:57:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-f9d55049-d57d-44b9-92c9-c75a02d2a30c" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:57:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 23:57:56 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:57:56 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:57:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:57:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:57:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:57:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:57:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:58:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:58:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:58:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:58:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:58:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:58:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:58:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:58:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:58:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:58:13 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:58:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 23:58:14 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:58:14 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:58:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.932228088378906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:58:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:58:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:58:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance f9d55049-d57d-44b9-92c9-c75a02d2a30c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 23:58:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:58:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:58:14 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:58:14 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:58:14 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:58:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:58:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:58:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:58:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:58:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:58:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:58:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:58:25 user nova-compute[74482]: INFO nova.compute.manager [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Terminating instance
Oct 23 23:58:25 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-6bb80708-eeef-4c35-acc1-2610d68af3d4 req-bb9c2776-d39e-4d14-b1b4-6442749e55b0 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received event network-vif-unplugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6bb80708-eeef-4c35-acc1-2610d68af3d4 req-bb9c2776-d39e-4d14-b1b4-6442749e55b0 service nova] Acquiring lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6bb80708-eeef-4c35-acc1-2610d68af3d4 req-bb9c2776-d39e-4d14-b1b4-6442749e55b0 service nova] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6bb80708-eeef-4c35-acc1-2610d68af3d4 req-bb9c2776-d39e-4d14-b1b4-6442749e55b0 service nova] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-6bb80708-eeef-4c35-acc1-2610d68af3d4 req-bb9c2776-d39e-4d14-b1b4-6442749e55b0 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] No waiting events found dispatching network-vif-unplugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG nova.compute.manager [req-6bb80708-eeef-4c35-acc1-2610d68af3d4 req-bb9c2776-d39e-4d14-b1b4-6442749e55b0 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received event network-vif-unplugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:25 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Instance destroyed successfully.
Oct 23 23:58:25 user nova-compute[74482]: DEBUG nova.objects.instance [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'resources' on Instance uuid f9d55049-d57d-44b9-92c9-c75a02d2a30c {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-971700351',display_name='tempest-TestVolumeBootPattern-server-971700351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-971700351',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T23:57:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-ciyl0s09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T23:57:01Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=f9d55049-d57d-44b9-92c9-c75a02d2a30c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "address": "fa:16:3e:a9:00:6a", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf48c5f-1a", "ovs_interfaceid": "4bf48c5f-1a28-4409-90fc-2fe8339dc835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=4bf48c5f-1a28-4409-90fc-2fe8339dc835,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf48c5f-1a') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_vif [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=4bf48c5f-1a28-4409-90fc-2fe8339dc835,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf48c5f-1a') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bf48c5f-1a, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29e54774-9a83-4f96-9351-50a9a995ce73) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:58:25 user nova-compute[74482]: INFO os_vif [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:00:6a,bridge_name='br-int',has_traffic_filtering=True,id=4bf48c5f-1a28-4409-90fc-2fe8339dc835,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf48c5f-1a')
Oct 23 23:58:25 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTuiLRsD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:58:25 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6647deac-be33-490a-849b-dd80008b538f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 23:58:25 user nova-compute[74482]: No targets found.
Oct 23 23:58:25 user nova-compute[74482]: iSNS:
Oct 23 23:58:25 user nova-compute[74482]: No targets found.
Oct 23 23:58:25 user nova-compute[74482]: STATIC:
Oct 23 23:58:25 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66
Oct 23 23:58:25 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 23 23:58:25 user nova-compute[74482]:                 Iface Name: default
Oct 23 23:58:25 user nova-compute[74482]: FIRMWARE:
Oct 23 23:58:25 user nova-compute[74482]: No targets found.
Oct 23 23:58:25 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 23:58:25 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 23:58:25 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[049988f9-6c02-4d2c-a16c-38deaa6c76f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b4e5b-9fdb-4a4f-80d7-11b6a3112ef9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 (non-flash)
Oct 23 23:58:25 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 (non-flash)
Oct 23 23:58:25 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c4a9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:25 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9821592-1f65-44e4-bca2-4dbfbd6b04f0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[71847d3c-e831-4b8c-9fea-5f5e7ed83283]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af6fb0-9870-4624-aa01-b4267e10dc56]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.079s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b9c25-cacb-4385-b4d6-c71302b0e487]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba109409-2027-470e-8270-f4a2a79e35f4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f54f850-4c78-461b-9252-9420b3475c95]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66, portal: 172.16.0.220,3260]
Oct 23 23:58:26 user nova-compute[74482]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66, portal: 172.16.0.220,3260] successful.
Oct 23 23:58:26 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c66adf6e-eff2-404a-8509-9a0728201e66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3e141d-4a3e-4268-8733-ee8dc7272874]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== disconnect_volume: return (345ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 23:58:26 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Deleting instance files /opt/stack/data/nova/instances/f9d55049-d57d-44b9-92c9-c75a02d2a30c_del
Oct 23 23:58:26 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Deletion of /opt/stack/data/nova/instances/f9d55049-d57d-44b9-92c9-c75a02d2a30c_del complete
Oct 23 23:58:26 user nova-compute[74482]: INFO nova.compute.manager [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 23 23:58:26 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 23:58:26 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:58:26 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Took 0.46 seconds to deallocate network for instance.
Oct 23 23:58:26 user nova-compute[74482]: DEBUG nova.compute.manager [req-94634cd2-6977-49ab-bcdd-896c2a8eb1dd req-b562599d-d723-4e92-afc5-e69c271131b7 service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received event network-vif-deleted-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:58:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-daf79bce-e00a-4e07-b7f0-8d0c46a43404 req-b889033f-1e72-4c9a-9958-7e3662d01cae service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received event network-vif-plugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:58:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-daf79bce-e00a-4e07-b7f0-8d0c46a43404 req-b889033f-1e72-4c9a-9958-7e3662d01cae service nova] Acquiring lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:58:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-daf79bce-e00a-4e07-b7f0-8d0c46a43404 req-b889033f-1e72-4c9a-9958-7e3662d01cae service nova] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:58:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-daf79bce-e00a-4e07-b7f0-8d0c46a43404 req-b889033f-1e72-4c9a-9958-7e3662d01cae service nova] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:58:27 user nova-compute[74482]: DEBUG nova.compute.manager [req-daf79bce-e00a-4e07-b7f0-8d0c46a43404 req-b889033f-1e72-4c9a-9958-7e3662d01cae service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] No waiting events found dispatching network-vif-plugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 23:58:27 user nova-compute[74482]: WARNING nova.compute.manager [req-daf79bce-e00a-4e07-b7f0-8d0c46a43404 req-b889033f-1e72-4c9a-9958-7e3662d01cae service nova] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Received unexpected event network-vif-plugged-4bf48c5f-1a28-4409-90fc-2fe8339dc835 for instance with vm_state active and task_state deleting.
Oct 23 23:58:28 user nova-compute[74482]: INFO nova.compute.manager [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Took 1.24 seconds to detach 1 volumes for instance.
Oct 23 23:58:28 user nova-compute[74482]: DEBUG nova.compute.manager [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: f9d55049-d57d-44b9-92c9-c75a02d2a30c] Deleting volume: c66adf6e-eff2-404a-8509-9a0728201e66 {{(pid=74482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 23:58:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:58:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:58:28 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:58:28 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:58:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:58:28 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Deleted allocations for instance f9d55049-d57d-44b9-92c9-c75a02d2a30c
Oct 23 23:58:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-91251668-bde5-426e-9e22-71347b221812 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "f9d55049-d57d-44b9-92c9-c75a02d2a30c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.470s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:58:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:58:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:58:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:58:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:58:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:58:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:58:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:58:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:58:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:58:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:58:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:59:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:59:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:59:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:59:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:59:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:59:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:59:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:59:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:59:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:59:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:59:15 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 23:59:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:16 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:59:16 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 23:59:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9109MB free_disk=24.931358337402344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 23:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:59:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 23:59:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 23:59:16 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:59:16 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:59:16 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 23:59:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:59:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 23:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 23:59:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "d5cb9185-750f-4827-98e9-5b7d99d5081e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 23:59:50 user nova-compute[74482]: INFO nova.compute.claims [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Claim successful on node user
Oct 23 23:59:50 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 23:59:50 user nova-compute[74482]: DEBUG nova.network.neutron [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 23:59:51 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 23:59:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG nova.policy [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7adbba189645ecb67794b738c87db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1bcbe0d3b94e158cc20c6905b80f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 23:59:51 user nova-compute[74482]: INFO nova.virt.block_device [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Booting with volume 8d394698-4819-4b77-a188-deff3fae3800 at /dev/vda
Oct 23 23:59:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG os_brick.utils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a38d9c6-59e7-4c5e-876c-0fb7a1379fdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4f15dc-ca26-47a9-8ea4-041019cf019b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4143732-caca-4ce2-99be-c72182e2b4d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aa9044-079e-47b1-a616-d5ad86ddbeaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 23:59:51 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 23:59:51 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fa1b84-1dda-46a3-9e19-11b2b966103a]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG os_brick.utils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updating existing volume attachment record: 00cfb550-2a76-4094-a159-991e83ae5289 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 23:59:51 user nova-compute[74482]: DEBUG nova.network.neutron [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Successfully created port: 479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.network.neutron [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Successfully updated port: 479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquired lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.network.neutron [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-09862365-b432-432b-bfa2-30e4f8064fe1 req-0db62992-3209-4f70-877e-494f6cab675c service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received event network-changed-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-09862365-b432-432b-bfa2-30e4f8064fe1 req-0db62992-3209-4f70-877e-494f6cab675c service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Refreshing instance network info cache due to event network-changed-479b82fc-7d95-4c52-a493-b9c27302b9e5. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-09862365-b432-432b-bfa2-30e4f8064fe1 req-0db62992-3209-4f70-877e-494f6cab675c service nova] Acquiring lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.network.neutron [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.network.neutron [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updating instance_info_cache with network_info: [{"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Releasing lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Instance network_info: |[{"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-09862365-b432-432b-bfa2-30e4f8064fe1 req-0db62992-3209-4f70-877e-494f6cab675c service nova] Acquired lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-09862365-b432-432b-bfa2-30e4f8064fe1 req-0db62992-3209-4f70-877e-494f6cab675c service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Refreshing network info cache for port 479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-09862365-b432-432b-bfa2-30e4f8064fe1 req-0db62992-3209-4f70-877e-494f6cab675c service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updated VIF entry in instance network info cache for port 479b82fc-7d95-4c52-a493-b9c27302b9e5. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-09862365-b432-432b-bfa2-30e4f8064fe1 req-0db62992-3209-4f70-877e-494f6cab675c service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updating instance_info_cache with network_info: [{"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 23:59:52 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-09862365-b432-432b-bfa2-30e4f8064fe1 req-0db62992-3209-4f70-877e-494f6cab675c service nova] Releasing lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 23:59:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 23:59:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:59:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 23:59:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 23:59:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Skipping network cache update for instance because it is Building. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 23:59:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 23:59:57 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:59:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:59:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 23:59:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 23:59:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:00:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:00:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:00:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:00:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:00:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:00:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:00:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:00:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 24 00:00:07 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Creating image(s)
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Ensure instance console log exists: /opt/stack/data/nova/instances/d5cb9185-750f-4827-98e9-5b7d99d5081e/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Start _get_guest_xml network_info=[{"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CaAcOpIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5cb9185-750f-4827-98e9-5b7d99d5081e', 'attached_at': '', 'detached_at': '', 'volume_id': '8d394698-4819-4b77-a188-deff3fae3800', 'serial': '8d394698-4819-4b77-a188-deff3fae3800'}, 'disk_bus': 'virtio', 'attachment_id': '00cfb550-2a76-4094-a159-991e83ae5289', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 24 00:00:07 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:00:07 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CaAcOpIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:00:07 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:00:07 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:00:07 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[364f816a-7dd8-43cb-a800-440f5efdb67f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 24 00:00:07 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d63dddd-e474-42d2-aae8-beb72e1fd052]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800] added
Oct 24 00:00:07 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d565f1-8fcd-4ec6-9154-a38f40c70ce9]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b67e32-9957-4de9-bdc1-32be34f4a80c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CaAcOpIG {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CaAcOpIG" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3aa9e6-bf5a-4741-86d8-6415ec723274]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CaAcOpIG'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4afc46b-221e-47a4-8e94-e9b139dfd440]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e4df2e-f1c3-4ef1-8b7e-250fbde96efe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:00:07 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:00:07 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:00:07 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 24 00:00:07 user nova-compute[74482]: 
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14a61b5-468d-4f7c-b056-dd2144fcb139]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800, portal: 172.16.0.220,3260]
Oct 24 00:00:07 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800, portal: 172.16.0.220,3260] successful.
Oct 24 00:00:07 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e4e8c9-2f59-49e6-83bd-b04186586497]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e42a8c7-0d1e-47d6-ace5-1cff2d097e48]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:00:07 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:00:07 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cc5d05-504f-4d76-b85f-3718d862f198]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:00:07 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CaAcOpIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26437613931663136', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437613931663136', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-232481457',display_name='tempest-TestVolumeBootPattern-volume-backed-server-232481457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-232481457',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHonjoRH8POI7Eok/qVOWhbdT9r7Y6sRfCyDgQ5wuirZ2FSmKRg0RtUF09iHvua+DorHIzuNkiasOkDHT92FxJF2kDQ9P3RbXyk9qot0F1QKIfc+oKq0P3+1G4n5ZS6G+Q==',key_name='tempest-keypair-967657175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-jf475c81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab7adbba189645ecb67794b738c87db1',uuid=d5cb9185-750f-4827-98e9-5b7d99d5081e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:25:14,bridge_name='br-int',has_traffic_filtering=True,id=479b82fc-7d95-4c52-a493-b9c27302b9e5,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479b82fc-7d') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.objects.instance [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'pci_devices' on Instance uuid d5cb9185-750f-4827-98e9-5b7d99d5081e {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] End _get_guest_xml xml=<domain type="kvm">
Oct 24 00:00:08 user nova-compute[74482]:   <uuid>d5cb9185-750f-4827-98e9-5b7d99d5081e</uuid>
Oct 24 00:00:08 user nova-compute[74482]:   <name>instance-00000030</name>
Oct 24 00:00:08 user nova-compute[74482]:   <memory>524288</memory>
Oct 24 00:00:08 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 24 00:00:08 user nova-compute[74482]:   <metadata>
Oct 24 00:00:08 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 24 00:00:08 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 24 00:00:08 user nova-compute[74482]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-232481457</nova:name>
Oct 24 00:00:08 user nova-compute[74482]:       <nova:creationTime>2023-10-24 00:00:07</nova:creationTime>
Oct 24 00:00:08 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 24 00:00:08 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 24 00:00:08 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 24 00:00:08 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 24 00:00:08 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 24 00:00:08 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 24 00:00:08 user nova-compute[74482]:       </nova:flavor>
Oct 24 00:00:08 user nova-compute[74482]:       <nova:owner>
Oct 24 00:00:08 user nova-compute[74482]:         <nova:user uuid="ab7adbba189645ecb67794b738c87db1">tempest-TestVolumeBootPattern-334654437-project-member</nova:user>
Oct 24 00:00:08 user nova-compute[74482]:         <nova:project uuid="bd1bcbe0d3b94e158cc20c6905b80f13">tempest-TestVolumeBootPattern-334654437</nova:project>
Oct 24 00:00:08 user nova-compute[74482]:       </nova:owner>
Oct 24 00:00:08 user nova-compute[74482]:       <nova:ports>
Oct 24 00:00:08 user nova-compute[74482]:         <nova:port uuid="479b82fc-7d95-4c52-a493-b9c27302b9e5">
Oct 24 00:00:08 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 24 00:00:08 user nova-compute[74482]:         </nova:port>
Oct 24 00:00:08 user nova-compute[74482]:       </nova:ports>
Oct 24 00:00:08 user nova-compute[74482]:     </nova:instance>
Oct 24 00:00:08 user nova-compute[74482]:   </metadata>
Oct 24 00:00:08 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 24 00:00:08 user nova-compute[74482]:     <system>
Oct 24 00:00:08 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 24 00:00:08 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 24 00:00:08 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 24 00:00:08 user nova-compute[74482]:       <entry name="serial">d5cb9185-750f-4827-98e9-5b7d99d5081e</entry>
Oct 24 00:00:08 user nova-compute[74482]:       <entry name="uuid">d5cb9185-750f-4827-98e9-5b7d99d5081e</entry>
Oct 24 00:00:08 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 24 00:00:08 user nova-compute[74482]:     </system>
Oct 24 00:00:08 user nova-compute[74482]:   </sysinfo>
Oct 24 00:00:08 user nova-compute[74482]:   <os>
Oct 24 00:00:08 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 24 00:00:08 user nova-compute[74482]:     <boot dev="hd"/>
Oct 24 00:00:08 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 24 00:00:08 user nova-compute[74482]:   </os>
Oct 24 00:00:08 user nova-compute[74482]:   <features>
Oct 24 00:00:08 user nova-compute[74482]:     <acpi/>
Oct 24 00:00:08 user nova-compute[74482]:     <apic/>
Oct 24 00:00:08 user nova-compute[74482]:     <vmcoreinfo/>
Oct 24 00:00:08 user nova-compute[74482]:   </features>
Oct 24 00:00:08 user nova-compute[74482]:   <clock offset="utc">
Oct 24 00:00:08 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 24 00:00:08 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 24 00:00:08 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 24 00:00:08 user nova-compute[74482]:   </clock>
Oct 24 00:00:08 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 24 00:00:08 user nova-compute[74482]:     <model>Nehalem</model>
Oct 24 00:00:08 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 24 00:00:08 user nova-compute[74482]:   </cpu>
Oct 24 00:00:08 user nova-compute[74482]:   <devices>
Oct 24 00:00:08 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 24 00:00:08 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:00:08 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 24 00:00:08 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 24 00:00:08 user nova-compute[74482]:       <serial>8d394698-4819-4b77-a188-deff3fae3800</serial>
Oct 24 00:00:08 user nova-compute[74482]:     </disk>
Oct 24 00:00:08 user nova-compute[74482]:     <interface type="ethernet">
Oct 24 00:00:08 user nova-compute[74482]:       <mac address="fa:16:3e:36:25:14"/>
Oct 24 00:00:08 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:00:08 user nova-compute[74482]:       <mtu size="1442"/>
Oct 24 00:00:08 user nova-compute[74482]:       <target dev="tap479b82fc-7d"/>
Oct 24 00:00:08 user nova-compute[74482]:     </interface>
Oct 24 00:00:08 user nova-compute[74482]:     <serial type="pty">
Oct 24 00:00:08 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/d5cb9185-750f-4827-98e9-5b7d99d5081e/console.log" append="off"/>
Oct 24 00:00:08 user nova-compute[74482]:     </serial>
Oct 24 00:00:08 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 24 00:00:08 user nova-compute[74482]:     <video>
Oct 24 00:00:08 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:00:08 user nova-compute[74482]:     </video>
Oct 24 00:00:08 user nova-compute[74482]:     <rng model="virtio">
Oct 24 00:00:08 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 24 00:00:08 user nova-compute[74482]:     </rng>
Oct 24 00:00:08 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 24 00:00:08 user nova-compute[74482]:     <memballoon model="virtio">
Oct 24 00:00:08 user nova-compute[74482]:       <stats period="10"/>
Oct 24 00:00:08 user nova-compute[74482]:     </memballoon>
Oct 24 00:00:08 user nova-compute[74482]:   </devices>
Oct 24 00:00:08 user nova-compute[74482]: </domain>
Oct 24 00:00:08 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-232481457',display_name='tempest-TestVolumeBootPattern-volume-backed-server-232481457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-232481457',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHonjoRH8POI7Eok/qVOWhbdT9r7Y6sRfCyDgQ5wuirZ2FSmKRg0RtUF09iHvua+DorHIzuNkiasOkDHT92FxJF2kDQ9P3RbXyk9qot0F1QKIfc+oKq0P3+1G4n5ZS6G+Q==',key_name='tempest-keypair-967657175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-jf475c81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T23:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab7adbba189645ecb67794b738c87db1',uuid=d5cb9185-750f-4827-98e9-5b7d99d5081e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:25:14,bridge_name='br-int',has_traffic_filtering=True,id=479b82fc-7d95-4c52-a493-b9c27302b9e5,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479b82fc-7d') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG os_vif [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:25:14,bridge_name='br-int',has_traffic_filtering=True,id=479b82fc-7d95-4c52-a493-b9c27302b9e5,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479b82fc-7d') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1446e19d-164e-515f-a280-92339b18874b', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap479b82fc-7d, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap479b82fc-7d, col_values=(('qos', UUID('4b43425b-7cfc-4343-98e1-855544d39dac')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap479b82fc-7d, col_values=(('external_ids', {'iface-id': '479b82fc-7d95-4c52-a493-b9c27302b9e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:25:14', 'vm-uuid': 'd5cb9185-750f-4827-98e9-5b7d99d5081e'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:08 user nova-compute[74482]: INFO os_vif [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:25:14,bridge_name='br-int',has_traffic_filtering=True,id=479b82fc-7d95-4c52-a493-b9c27302b9e5,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479b82fc-7d')
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:00:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No VIF found with MAC fa:16:3e:36:25:14, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:00:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-c3e16e5a-d741-4f10-9eb1-aa65b7f41152 req-2e97b729-3fd4-4d52-8b7e-7897aa26cb15 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received event network-vif-plugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:00:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c3e16e5a-d741-4f10-9eb1-aa65b7f41152 req-2e97b729-3fd4-4d52-8b7e-7897aa26cb15 service nova] Acquiring lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:00:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c3e16e5a-d741-4f10-9eb1-aa65b7f41152 req-2e97b729-3fd4-4d52-8b7e-7897aa26cb15 service nova] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:00:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c3e16e5a-d741-4f10-9eb1-aa65b7f41152 req-2e97b729-3fd4-4d52-8b7e-7897aa26cb15 service nova] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:00:10 user nova-compute[74482]: DEBUG nova.compute.manager [req-c3e16e5a-d741-4f10-9eb1-aa65b7f41152 req-2e97b729-3fd4-4d52-8b7e-7897aa26cb15 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] No waiting events found dispatching network-vif-plugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:00:10 user nova-compute[74482]: WARNING nova.compute.manager [req-c3e16e5a-d741-4f10-9eb1-aa65b7f41152 req-2e97b729-3fd4-4d52-8b7e-7897aa26cb15 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received unexpected event network-vif-plugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 for instance with vm_state building and task_state spawning.
Oct 24 00:00:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 24 00:00:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 24 00:00:11 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Instance spawned successfully.
Oct 24 00:00:11 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:00:12 user nova-compute[74482]: INFO nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Took 4.89 seconds to spawn the instance on the hypervisor.
Oct 24 00:00:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 24 00:00:12 user nova-compute[74482]: INFO nova.compute.manager [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Took 21.44 seconds to build instance.
Oct 24 00:00:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-2dfe0575-5023-4697-a1ad-a138b39439de tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.538s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-5b20ae12-e019-43bc-aab9-79d8bfbc406b req-6f369331-5af7-45c8-8e38-44676c19e037 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received event network-vif-plugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5b20ae12-e019-43bc-aab9-79d8bfbc406b req-6f369331-5af7-45c8-8e38-44676c19e037 service nova] Acquiring lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5b20ae12-e019-43bc-aab9-79d8bfbc406b req-6f369331-5af7-45c8-8e38-44676c19e037 service nova] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5b20ae12-e019-43bc-aab9-79d8bfbc406b req-6f369331-5af7-45c8-8e38-44676c19e037 service nova] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:00:12 user nova-compute[74482]: DEBUG nova.compute.manager [req-5b20ae12-e019-43bc-aab9-79d8bfbc406b req-6f369331-5af7-45c8-8e38-44676c19e037 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] No waiting events found dispatching network-vif-plugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:00:12 user nova-compute[74482]: WARNING nova.compute.manager [req-5b20ae12-e019-43bc-aab9-79d8bfbc406b req-6f369331-5af7-45c8-8e38-44676c19e037 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received unexpected event network-vif-plugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 for instance with vm_state active and task_state None.
Oct 24 00:00:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:00:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:00:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:00:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:00:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:00:17 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:00:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:00:18 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:00:18 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:00:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=24.928558349609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance d5cb9185-750f-4827-98e9-5b7d99d5081e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:00:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:00:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:00:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:00:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:00:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:00:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid d5cb9185-750f-4827-98e9-5b7d99d5081e {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updating instance_info_cache with network_info: [{"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:00:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:01:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:01:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:01:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 24 00:01:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 24 00:01:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 24 00:01:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:01:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:01:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:01:17 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:01:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:01:18 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:01:18 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=24.927913665771484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance d5cb9185-750f-4827-98e9-5b7d99d5081e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:01:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:01:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-04c1fa01-5273-4fd3-ac63-3762ee127edb req-3a42078b-7e0d-4b5c-88cf-8da1ddf34f1b service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received event network-changed-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:01:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-04c1fa01-5273-4fd3-ac63-3762ee127edb req-3a42078b-7e0d-4b5c-88cf-8da1ddf34f1b service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Refreshing instance network info cache due to event network-changed-479b82fc-7d95-4c52-a493-b9c27302b9e5. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:01:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-04c1fa01-5273-4fd3-ac63-3762ee127edb req-3a42078b-7e0d-4b5c-88cf-8da1ddf34f1b service nova] Acquiring lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:01:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-04c1fa01-5273-4fd3-ac63-3762ee127edb req-3a42078b-7e0d-4b5c-88cf-8da1ddf34f1b service nova] Acquired lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:01:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-04c1fa01-5273-4fd3-ac63-3762ee127edb req-3a42078b-7e0d-4b5c-88cf-8da1ddf34f1b service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Refreshing network info cache for port 479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:01:42 user nova-compute[74482]: DEBUG nova.network.neutron [req-04c1fa01-5273-4fd3-ac63-3762ee127edb req-3a42078b-7e0d-4b5c-88cf-8da1ddf34f1b service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updated VIF entry in instance network info cache for port 479b82fc-7d95-4c52-a493-b9c27302b9e5. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:01:42 user nova-compute[74482]: DEBUG nova.network.neutron [req-04c1fa01-5273-4fd3-ac63-3762ee127edb req-3a42078b-7e0d-4b5c-88cf-8da1ddf34f1b service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updating instance_info_cache with network_info: [{"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:01:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-04c1fa01-5273-4fd3-ac63-3762ee127edb req-3a42078b-7e0d-4b5c-88cf-8da1ddf34f1b service nova] Releasing lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:01:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:01:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "504ea112-b5b7-4b2c-8962-e842eb87b294" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:01:54 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:01:54 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 24 00:01:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:01:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:01:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 24 00:01:55 user nova-compute[74482]: INFO nova.compute.claims [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Claim successful on node user
Oct 24 00:01:55 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:01:55 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:01:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:01:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 24 00:01:55 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 24 00:01:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 24 00:01:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 24 00:01:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 24 00:01:55 user nova-compute[74482]: INFO nova.virt.block_device [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Booting with volume snapshot 803db955-1627-44de-a895-50867a92a786 at /dev/vda
Oct 24 00:01:55 user nova-compute[74482]: DEBUG nova.policy [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7adbba189645ecb67794b738c87db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1bcbe0d3b94e158cc20c6905b80f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 24 00:01:55 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Successfully created port: c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 24 00:01:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Successfully updated port: c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 24 00:01:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "refresh_cache-504ea112-b5b7-4b2c-8962-e842eb87b294" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:01:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquired lock "refresh_cache-504ea112-b5b7-4b2c-8962-e842eb87b294" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:01:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 24 00:01:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-3e816043-da3c-41b6-ad52-b9ee2d24f1d7 req-adb0fc4f-a682-468b-8ace-84cec6e650cb service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received event network-changed-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:01:56 user nova-compute[74482]: DEBUG nova.compute.manager [req-3e816043-da3c-41b6-ad52-b9ee2d24f1d7 req-adb0fc4f-a682-468b-8ace-84cec6e650cb service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Refreshing instance network info cache due to event network-changed-c7430130-e060-4a88-9bb5-f0a6a2b44f73. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:01:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3e816043-da3c-41b6-ad52-b9ee2d24f1d7 req-adb0fc4f-a682-468b-8ace-84cec6e650cb service nova] Acquiring lock "refresh_cache-504ea112-b5b7-4b2c-8962-e842eb87b294" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:01:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 24 00:01:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Updating instance_info_cache with network_info: [{"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:01:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Releasing lock "refresh_cache-504ea112-b5b7-4b2c-8962-e842eb87b294" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:01:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Instance network_info: |[{"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 24 00:01:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3e816043-da3c-41b6-ad52-b9ee2d24f1d7 req-adb0fc4f-a682-468b-8ace-84cec6e650cb service nova] Acquired lock "refresh_cache-504ea112-b5b7-4b2c-8962-e842eb87b294" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:01:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-3e816043-da3c-41b6-ad52-b9ee2d24f1d7 req-adb0fc4f-a682-468b-8ace-84cec6e650cb service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Refreshing network info cache for port c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:01:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-3e816043-da3c-41b6-ad52-b9ee2d24f1d7 req-adb0fc4f-a682-468b-8ace-84cec6e650cb service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Updated VIF entry in instance network info cache for port c7430130-e060-4a88-9bb5-f0a6a2b44f73. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:01:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-3e816043-da3c-41b6-ad52-b9ee2d24f1d7 req-adb0fc4f-a682-468b-8ace-84cec6e650cb service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Updating instance_info_cache with network_info: [{"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:01:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-3e816043-da3c-41b6-ad52-b9ee2d24f1d7 req-adb0fc4f-a682-468b-8ace-84cec6e650cb service nova] Releasing lock "refresh_cache-504ea112-b5b7-4b2c-8962-e842eb87b294" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:01:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:01:58 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:01:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:01:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:01:58 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Skipping network cache update for instance because it is Building. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 24 00:01:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:01:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:01:58 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:01:58 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid d5cb9185-750f-4827-98e9-5b7d99d5081e {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:01:59 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updating instance_info_cache with network_info: [{"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:01:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:01:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:01:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG os_brick.utils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22b7bd0-0679-4e5e-87a3-6903441b868d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[388a5a42-b560-4f2f-a908-bc2438647e5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a8de1-7793-47d9-a373-069364e398e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ab3b3c-5222-43d4-a149-5f7be78dfee9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:02:01 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc2db3d-be98-470b-9aa2-d1bc29f0cb1b]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG os_brick.utils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Updating existing volume attachment record: a6765763-a204-4dab-a824-354806c7b607 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:02:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:02:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 24 00:02:17 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Creating image(s)
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Ensure instance console log exists: /opt/stack/data/nova/instances/504ea112-b5b7-4b2c-8962-e842eb87b294/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Start _get_guest_xml network_info=[{"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-24T00:01:44Z,direct_url=<?>,disk_format='qcow2',id=86414a03-1770-40e7-9792-a147bf7aefd9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1984890099',owner='bd1bcbe0d3b94e158cc20c6905b80f13',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-24T00:01:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXeFAcMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '504ea112-b5b7-4b2c-8962-e842eb87b294', 'attached_at': '', 'detached_at': '', 'volume_id': '1a55046f-cbc0-44ec-a009-2dcec7314eee', 'serial': '1a55046f-cbc0-44ec-a009-2dcec7314eee'}, 'disk_bus': 'virtio', 'attachment_id': 'a6765763-a204-4dab-a824-354806c7b607', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 24 00:02:17 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:02:17 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-24T00:01:44Z,direct_url=<?>,disk_format='qcow2',id=86414a03-1770-40e7-9792-a147bf7aefd9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1984890099',owner='bd1bcbe0d3b94e158cc20c6905b80f13',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-24T00:01:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXeFAcMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:02:17 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:02:17 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:02:17 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fcc3ed-3622-4272-a678-86d5aa48c167]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 24 00:02:17 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d005488-52f2-4762-b004-b22f8f2ee1c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee] added
Oct 24 00:02:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7f124c-b81c-42d8-acee-82bb44e95449]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7653fa-e0d4-499b-b3b8-2a1d4789d9e0]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXeFAcMo {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXeFAcMo" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5426a55-9cc8-475a-b653-bcb56f5c4061]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jXeFAcMo'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b655d5d-eecd-4b97-88d2-d2402dfc70bb]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[86070064-da54-4e05-a866-12edd22f1fa0]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:02:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:02:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[106542d9-d24b-4b50-8c5a-42312a3b5610]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee, portal: 172.16.0.220,3260]
Oct 24 00:02:17 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee, portal: 172.16.0.220,3260] successful.
Oct 24 00:02:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed42c9da-2ba8-41da-928a-d970728223ff]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2191ed55-23dc-47ca-aff9-01fa79e50f36]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:02:17 user nova-compute[74482]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee (non-flash)
Oct 24 00:02:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:02:17 user nova-compute[74482]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee (non-flash)
Oct 24 00:02:17 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bf252f-93d0-4c87-bcf2-369789ea0e04]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:02:17 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXeFAcMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23634303265643166', 'path': '/dev/sdc'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634303265643166', 'path': '/dev/sdc'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2010486055',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2010486055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2010486055',id=49,image_ref='86414a03-1770-40e7-9792-a147bf7aefd9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI7qWvgQXdoBKZzbGqFjWqOOOUKf25tSx0pP8EcAJ1aIUeCCLMPgP1d2ciGz8bH5D9zJBty2qQeZiLmvS1F4BVCk5uRsrJXNaplK9+HcIcOMiJca9faEfZUFAO3QHDxdQ==',key_name='tempest-keypair-1243220913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-84d06fm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-334654437',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab7adbba189645ecb67794b738c87db1',uuid=504ea112-b5b7-4b2c-8962-e842eb87b294,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ca:89,bridge_name='br-int',has_traffic_filtering=True,id=c7430130-e060-4a88-9bb5-f0a6a2b44f73,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7430130-e0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'pci_devices' on Instance uuid 504ea112-b5b7-4b2c-8962-e842eb87b294 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] End _get_guest_xml xml=<domain type="kvm">
Oct 24 00:02:18 user nova-compute[74482]:   <uuid>504ea112-b5b7-4b2c-8962-e842eb87b294</uuid>
Oct 24 00:02:18 user nova-compute[74482]:   <name>instance-00000031</name>
Oct 24 00:02:18 user nova-compute[74482]:   <memory>524288</memory>
Oct 24 00:02:18 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 24 00:02:18 user nova-compute[74482]:   <metadata>
Oct 24 00:02:18 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 24 00:02:18 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 24 00:02:18 user nova-compute[74482]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2010486055</nova:name>
Oct 24 00:02:18 user nova-compute[74482]:       <nova:creationTime>2023-10-24 00:02:17</nova:creationTime>
Oct 24 00:02:18 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 24 00:02:18 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 24 00:02:18 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 24 00:02:18 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 24 00:02:18 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 24 00:02:18 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 24 00:02:18 user nova-compute[74482]:       </nova:flavor>
Oct 24 00:02:18 user nova-compute[74482]:       <nova:owner>
Oct 24 00:02:18 user nova-compute[74482]:         <nova:user uuid="ab7adbba189645ecb67794b738c87db1">tempest-TestVolumeBootPattern-334654437-project-member</nova:user>
Oct 24 00:02:18 user nova-compute[74482]:         <nova:project uuid="bd1bcbe0d3b94e158cc20c6905b80f13">tempest-TestVolumeBootPattern-334654437</nova:project>
Oct 24 00:02:18 user nova-compute[74482]:       </nova:owner>
Oct 24 00:02:18 user nova-compute[74482]:       <nova:root type="image" uuid="86414a03-1770-40e7-9792-a147bf7aefd9"/>
Oct 24 00:02:18 user nova-compute[74482]:       <nova:ports>
Oct 24 00:02:18 user nova-compute[74482]:         <nova:port uuid="c7430130-e060-4a88-9bb5-f0a6a2b44f73">
Oct 24 00:02:18 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 24 00:02:18 user nova-compute[74482]:         </nova:port>
Oct 24 00:02:18 user nova-compute[74482]:       </nova:ports>
Oct 24 00:02:18 user nova-compute[74482]:     </nova:instance>
Oct 24 00:02:18 user nova-compute[74482]:   </metadata>
Oct 24 00:02:18 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 24 00:02:18 user nova-compute[74482]:     <system>
Oct 24 00:02:18 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 24 00:02:18 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 24 00:02:18 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 24 00:02:18 user nova-compute[74482]:       <entry name="serial">504ea112-b5b7-4b2c-8962-e842eb87b294</entry>
Oct 24 00:02:18 user nova-compute[74482]:       <entry name="uuid">504ea112-b5b7-4b2c-8962-e842eb87b294</entry>
Oct 24 00:02:18 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 24 00:02:18 user nova-compute[74482]:     </system>
Oct 24 00:02:18 user nova-compute[74482]:   </sysinfo>
Oct 24 00:02:18 user nova-compute[74482]:   <os>
Oct 24 00:02:18 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 24 00:02:18 user nova-compute[74482]:     <boot dev="hd"/>
Oct 24 00:02:18 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 24 00:02:18 user nova-compute[74482]:   </os>
Oct 24 00:02:18 user nova-compute[74482]:   <features>
Oct 24 00:02:18 user nova-compute[74482]:     <acpi/>
Oct 24 00:02:18 user nova-compute[74482]:     <apic/>
Oct 24 00:02:18 user nova-compute[74482]:     <vmcoreinfo/>
Oct 24 00:02:18 user nova-compute[74482]:   </features>
Oct 24 00:02:18 user nova-compute[74482]:   <clock offset="utc">
Oct 24 00:02:18 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 24 00:02:18 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 24 00:02:18 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 24 00:02:18 user nova-compute[74482]:   </clock>
Oct 24 00:02:18 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 24 00:02:18 user nova-compute[74482]:     <model>Nehalem</model>
Oct 24 00:02:18 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 24 00:02:18 user nova-compute[74482]:   </cpu>
Oct 24 00:02:18 user nova-compute[74482]:   <devices>
Oct 24 00:02:18 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 24 00:02:18 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:02:18 user nova-compute[74482]:       <source dev="/dev/sdc"/>
Oct 24 00:02:18 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 24 00:02:18 user nova-compute[74482]:       <serial>1a55046f-cbc0-44ec-a009-2dcec7314eee</serial>
Oct 24 00:02:18 user nova-compute[74482]:     </disk>
Oct 24 00:02:18 user nova-compute[74482]:     <interface type="ethernet">
Oct 24 00:02:18 user nova-compute[74482]:       <mac address="fa:16:3e:80:ca:89"/>
Oct 24 00:02:18 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:02:18 user nova-compute[74482]:       <mtu size="1442"/>
Oct 24 00:02:18 user nova-compute[74482]:       <target dev="tapc7430130-e0"/>
Oct 24 00:02:18 user nova-compute[74482]:     </interface>
Oct 24 00:02:18 user nova-compute[74482]:     <serial type="pty">
Oct 24 00:02:18 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/504ea112-b5b7-4b2c-8962-e842eb87b294/console.log" append="off"/>
Oct 24 00:02:18 user nova-compute[74482]:     </serial>
Oct 24 00:02:18 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 24 00:02:18 user nova-compute[74482]:     <video>
Oct 24 00:02:18 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:02:18 user nova-compute[74482]:     </video>
Oct 24 00:02:18 user nova-compute[74482]:     <rng model="virtio">
Oct 24 00:02:18 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 24 00:02:18 user nova-compute[74482]:     </rng>
Oct 24 00:02:18 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 24 00:02:18 user nova-compute[74482]:     <memballoon model="virtio">
Oct 24 00:02:18 user nova-compute[74482]:       <stats period="10"/>
Oct 24 00:02:18 user nova-compute[74482]:     </memballoon>
Oct 24 00:02:18 user nova-compute[74482]:   </devices>
Oct 24 00:02:18 user nova-compute[74482]: </domain>
Oct 24 00:02:18 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2010486055',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2010486055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2010486055',id=49,image_ref='86414a03-1770-40e7-9792-a147bf7aefd9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI7qWvgQXdoBKZzbGqFjWqOOOUKf25tSx0pP8EcAJ1aIUeCCLMPgP1d2ciGz8bH5D9zJBty2qQeZiLmvS1F4BVCk5uRsrJXNaplK9+HcIcOMiJca9faEfZUFAO3QHDxdQ==',key_name='tempest-keypair-1243220913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-84d06fm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-334654437',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab7adbba189645ecb67794b738c87db1',uuid=504ea112-b5b7-4b2c-8962-e842eb87b294,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ca:89,bridge_name='br-int',has_traffic_filtering=True,id=c7430130-e060-4a88-9bb5-f0a6a2b44f73,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7430130-e0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG os_vif [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ca:89,bridge_name='br-int',has_traffic_filtering=True,id=c7430130-e060-4a88-9bb5-f0a6a2b44f73,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7430130-e0') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11acd60c-1000-54b9-965d-773ed7487bae', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:02:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7430130-e0, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7430130-e0, col_values=(('qos', UUID('8dd36bf0-7806-4835-a6f2-fe5643dff55d')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7430130-e0, col_values=(('external_ids', {'iface-id': 'c7430130-e060-4a88-9bb5-f0a6a2b44f73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:ca:89', 'vm-uuid': '504ea112-b5b7-4b2c-8962-e842eb87b294'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:02:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:02:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=24.918682098388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:19 user nova-compute[74482]: INFO os_vif [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ca:89,bridge_name='br-int',has_traffic_filtering=True,id=c7430130-e060-4a88-9bb5-f0a6a2b44f73,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7430130-e0')
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No VIF found with MAC fa:16:3e:80:ca:89, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance d5cb9185-750f-4827-98e9-5b7d99d5081e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 504ea112-b5b7-4b2c-8962-e842eb87b294 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:02:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:02:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-2dba0eba-e36b-4416-a572-bcc1fa239d97 req-8b2208da-bec7-4053-884e-eac5ad7dcac6 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received event network-vif-plugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2dba0eba-e36b-4416-a572-bcc1fa239d97 req-8b2208da-bec7-4053-884e-eac5ad7dcac6 service nova] Acquiring lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2dba0eba-e36b-4416-a572-bcc1fa239d97 req-8b2208da-bec7-4053-884e-eac5ad7dcac6 service nova] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:02:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2dba0eba-e36b-4416-a572-bcc1fa239d97 req-8b2208da-bec7-4053-884e-eac5ad7dcac6 service nova] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:02:20 user nova-compute[74482]: DEBUG nova.compute.manager [req-2dba0eba-e36b-4416-a572-bcc1fa239d97 req-8b2208da-bec7-4053-884e-eac5ad7dcac6 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] No waiting events found dispatching network-vif-plugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:02:20 user nova-compute[74482]: WARNING nova.compute.manager [req-2dba0eba-e36b-4416-a572-bcc1fa239d97 req-8b2208da-bec7-4053-884e-eac5ad7dcac6 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received unexpected event network-vif-plugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 for instance with vm_state building and task_state spawning.
Oct 24 00:02:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 24 00:02:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 24 00:02:22 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Instance spawned successfully.
Oct 24 00:02:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 24 00:02:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:02:22 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:02:22 user nova-compute[74482]: INFO nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Took 5.17 seconds to spawn the instance on the hypervisor.
Oct 24 00:02:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 24 00:02:22 user nova-compute[74482]: INFO nova.compute.manager [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Took 27.70 seconds to build instance.
Oct 24 00:02:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e43a309e-3f1b-4256-b918-137a12201ef0 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.805s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:02:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-f29d02f4-3e9d-4b00-9919-af50e6677a0e req-470d166f-7e37-4f5d-b94b-92605cb85c32 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received event network-vif-plugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:02:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f29d02f4-3e9d-4b00-9919-af50e6677a0e req-470d166f-7e37-4f5d-b94b-92605cb85c32 service nova] Acquiring lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:02:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f29d02f4-3e9d-4b00-9919-af50e6677a0e req-470d166f-7e37-4f5d-b94b-92605cb85c32 service nova] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:02:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f29d02f4-3e9d-4b00-9919-af50e6677a0e req-470d166f-7e37-4f5d-b94b-92605cb85c32 service nova] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:02:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-f29d02f4-3e9d-4b00-9919-af50e6677a0e req-470d166f-7e37-4f5d-b94b-92605cb85c32 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] No waiting events found dispatching network-vif-plugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:02:22 user nova-compute[74482]: WARNING nova.compute.manager [req-f29d02f4-3e9d-4b00-9919-af50e6677a0e req-470d166f-7e37-4f5d-b94b-92605cb85c32 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received unexpected event network-vif-plugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 for instance with vm_state active and task_state None.
Oct 24 00:02:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:02:59 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid d5cb9185-750f-4827-98e9-5b7d99d5081e {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:03:00 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updating instance_info_cache with network_info: [{"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:03:00 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-d5cb9185-750f-4827-98e9-5b7d99d5081e" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:03:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:03:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:03:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:03:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:03:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:03:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:03:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:03:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:03:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:03:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:03:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:03:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:03:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:03:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:03:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:03:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:03:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:03:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:03:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8864MB free_disk=24.91744613647461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance d5cb9185-750f-4827-98e9-5b7d99d5081e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 504ea112-b5b7-4b2c-8962-e842eb87b294 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:03:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:03:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-413ffdcd-c0bb-4d5e-b5e1-a0d2ff68ec04 req-b4dc5f6c-051f-4b72-83d3-41c304b45e9c service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received event network-changed-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:03:45 user nova-compute[74482]: DEBUG nova.compute.manager [req-413ffdcd-c0bb-4d5e-b5e1-a0d2ff68ec04 req-b4dc5f6c-051f-4b72-83d3-41c304b45e9c service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Refreshing instance network info cache due to event network-changed-c7430130-e060-4a88-9bb5-f0a6a2b44f73. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:03:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-413ffdcd-c0bb-4d5e-b5e1-a0d2ff68ec04 req-b4dc5f6c-051f-4b72-83d3-41c304b45e9c service nova] Acquiring lock "refresh_cache-504ea112-b5b7-4b2c-8962-e842eb87b294" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:03:45 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-413ffdcd-c0bb-4d5e-b5e1-a0d2ff68ec04 req-b4dc5f6c-051f-4b72-83d3-41c304b45e9c service nova] Acquired lock "refresh_cache-504ea112-b5b7-4b2c-8962-e842eb87b294" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:03:45 user nova-compute[74482]: DEBUG nova.network.neutron [req-413ffdcd-c0bb-4d5e-b5e1-a0d2ff68ec04 req-b4dc5f6c-051f-4b72-83d3-41c304b45e9c service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Refreshing network info cache for port c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG nova.network.neutron [req-413ffdcd-c0bb-4d5e-b5e1-a0d2ff68ec04 req-b4dc5f6c-051f-4b72-83d3-41c304b45e9c service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Updated VIF entry in instance network info cache for port c7430130-e060-4a88-9bb5-f0a6a2b44f73. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG nova.network.neutron [req-413ffdcd-c0bb-4d5e-b5e1-a0d2ff68ec04 req-b4dc5f6c-051f-4b72-83d3-41c304b45e9c service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Updating instance_info_cache with network_info: [{"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-413ffdcd-c0bb-4d5e-b5e1-a0d2ff68ec04 req-b4dc5f6c-051f-4b72-83d3-41c304b45e9c service nova] Releasing lock "refresh_cache-504ea112-b5b7-4b2c-8962-e842eb87b294" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "504ea112-b5b7-4b2c-8962-e842eb87b294" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:03:46 user nova-compute[74482]: INFO nova.compute.manager [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Terminating instance
Oct 24 00:03:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-7f721d34-60b1-4894-af95-9ba5d284bb4d req-c469b908-b745-49f8-8050-3446dc417546 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received event network-vif-unplugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7f721d34-60b1-4894-af95-9ba5d284bb4d req-c469b908-b745-49f8-8050-3446dc417546 service nova] Acquiring lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7f721d34-60b1-4894-af95-9ba5d284bb4d req-c469b908-b745-49f8-8050-3446dc417546 service nova] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7f721d34-60b1-4894-af95-9ba5d284bb4d req-c469b908-b745-49f8-8050-3446dc417546 service nova] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-7f721d34-60b1-4894-af95-9ba5d284bb4d req-c469b908-b745-49f8-8050-3446dc417546 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] No waiting events found dispatching network-vif-unplugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-7f721d34-60b1-4894-af95-9ba5d284bb4d req-c469b908-b745-49f8-8050-3446dc417546 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received event network-vif-unplugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Instance destroyed successfully.
Oct 24 00:03:47 user nova-compute[74482]: DEBUG nova.objects.instance [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'resources' on Instance uuid 504ea112-b5b7-4b2c-8962-e842eb87b294 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2010486055',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2010486055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2010486055',id=49,image_ref='86414a03-1770-40e7-9792-a147bf7aefd9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI7qWvgQXdoBKZzbGqFjWqOOOUKf25tSx0pP8EcAJ1aIUeCCLMPgP1d2ciGz8bH5D9zJBty2qQeZiLmvS1F4BVCk5uRsrJXNaplK9+HcIcOMiJca9faEfZUFAO3QHDxdQ==',key_name='tempest-keypair-1243220913',keypairs=<?>,launch_index=0,launched_at=2023-10-24T00:02:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-84d06fm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-334654437',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-24T00:02:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab7adbba189645ecb67794b738c87db1',uuid=504ea112-b5b7-4b2c-8962-e842eb87b294,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "address": "fa:16:3e:80:ca:89", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7430130-e0", "ovs_interfaceid": "c7430130-e060-4a88-9bb5-f0a6a2b44f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:ca:89,bridge_name='br-int',has_traffic_filtering=True,id=c7430130-e060-4a88-9bb5-f0a6a2b44f73,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7430130-e0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_vif [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:ca:89,bridge_name='br-int',has_traffic_filtering=True,id=c7430130-e060-4a88-9bb5-f0a6a2b44f73,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7430130-e0') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7430130-e0, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dd36bf0-7806-4835-a6f2-fe5643dff55d) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:03:47 user nova-compute[74482]: INFO os_vif [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:ca:89,bridge_name='br-int',has_traffic_filtering=True,id=c7430130-e060-4a88-9bb5-f0a6a2b44f73,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7430130-e0')
Oct 24 00:03:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXeFAcMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:03:47 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8c2794-4592-4776-afd2-3d10d44c1253]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 24 00:03:47 user nova-compute[74482]: No targets found.
Oct 24 00:03:47 user nova-compute[74482]: iSNS:
Oct 24 00:03:47 user nova-compute[74482]: No targets found.
Oct 24 00:03:47 user nova-compute[74482]: STATIC:
Oct 24 00:03:47 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800
Oct 24 00:03:47 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:03:47 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:03:47 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee
Oct 24 00:03:47 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:03:47 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:03:47 user nova-compute[74482]: FIRMWARE:
Oct 24 00:03:47 user nova-compute[74482]: No targets found.
Oct 24 00:03:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 24 00:03:47 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 24 00:03:47 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d80246a-08c8-4f95-a066-a94bf509bdbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c28b14-497d-42b0-b616-a680be1aa8ab]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:03:47 user nova-compute[74482]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee (non-flash)
Oct 24 00:03:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:03:47 user nova-compute[74482]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee (non-flash)
Oct 24 00:03:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c636050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee'): ({'sdc'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Removing single pathed devices sdc {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed69de5-1b4f-45ea-a1b8-609b63e41f91]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f159675-25fb-4c19-8afa-e2fe5a6dc257]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flushing IO for device /dev/sdc {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c06e67-3dd6-4472-96c2-8e32b7d2deb6]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cd7d4b-1e3d-4c95-9048-410c56d2a3ed]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23634303265643166', '/dev/disk/by-id/scsi-1SCST_BIOba25a0a0-6402ed1f15394f41', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ba25a0a0') {{(pid=86306) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d74791-aad2-4ca0-9164-206bd71bf4d9]: (4, None) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4917334b-88e9-435f-9d75-d9ec738b61a3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f10ab-b0ec-46ff-b7e7-b00d677ffe2f]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee, portal: 172.16.0.220,3260]
Oct 24 00:03:47 user nova-compute[74482]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee, portal: 172.16.0.220,3260] successful.
Oct 24 00:03:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a55046f-cbc0-44ec-a009-2dcec7314eee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e913a424-1121-4f57-964a-3440b0867e2f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== disconnect_volume: return (323ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 24 00:03:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Deleting instance files /opt/stack/data/nova/instances/504ea112-b5b7-4b2c-8962-e842eb87b294_del
Oct 24 00:03:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Deletion of /opt/stack/data/nova/instances/504ea112-b5b7-4b2c-8962-e842eb87b294_del complete
Oct 24 00:03:47 user nova-compute[74482]: INFO nova.compute.manager [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 24 00:03:47 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 24 00:03:47 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 24 00:03:48 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:03:48 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Took 0.95 seconds to deallocate network for instance.
Oct 24 00:03:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-11ab8183-8cd8-424c-acb0-792501ab9493 req-5f9a2624-e52c-4ccb-85a2-1170780163dc service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received event network-vif-deleted-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:03:48 user nova-compute[74482]: INFO nova.compute.manager [req-11ab8183-8cd8-424c-acb0-792501ab9493 req-5f9a2624-e52c-4ccb-85a2-1170780163dc service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Neutron deleted interface c7430130-e060-4a88-9bb5-f0a6a2b44f73; detaching it from the instance and deleting it from the info cache
Oct 24 00:03:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-11ab8183-8cd8-424c-acb0-792501ab9493 req-5f9a2624-e52c-4ccb-85a2-1170780163dc service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:03:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-11ab8183-8cd8-424c-acb0-792501ab9493 req-5f9a2624-e52c-4ccb-85a2-1170780163dc service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Detach interface failed, port_id=c7430130-e060-4a88-9bb5-f0a6a2b44f73, reason: Instance 504ea112-b5b7-4b2c-8962-e842eb87b294 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 24 00:03:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-6092b719-18a4-4222-9733-8af0721106f7 req-bad9241d-8bac-40f2-a4f2-b9bc192f17b4 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received event network-vif-plugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:03:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6092b719-18a4-4222-9733-8af0721106f7 req-bad9241d-8bac-40f2-a4f2-b9bc192f17b4 service nova] Acquiring lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:03:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6092b719-18a4-4222-9733-8af0721106f7 req-bad9241d-8bac-40f2-a4f2-b9bc192f17b4 service nova] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:03:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6092b719-18a4-4222-9733-8af0721106f7 req-bad9241d-8bac-40f2-a4f2-b9bc192f17b4 service nova] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:03:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-6092b719-18a4-4222-9733-8af0721106f7 req-bad9241d-8bac-40f2-a4f2-b9bc192f17b4 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] No waiting events found dispatching network-vif-plugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:03:48 user nova-compute[74482]: WARNING nova.compute.manager [req-6092b719-18a4-4222-9733-8af0721106f7 req-bad9241d-8bac-40f2-a4f2-b9bc192f17b4 service nova] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Received unexpected event network-vif-plugged-c7430130-e060-4a88-9bb5-f0a6a2b44f73 for instance with vm_state active and task_state deleting.
Oct 24 00:03:49 user nova-compute[74482]: INFO nova.compute.manager [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Took 0.79 seconds to detach 1 volumes for instance.
Oct 24 00:03:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 504ea112-b5b7-4b2c-8962-e842eb87b294] Deleting volume: 1a55046f-cbc0-44ec-a009-2dcec7314eee {{(pid=74482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 24 00:03:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:03:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:03:49 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:03:49 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:03:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:03:49 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Deleted allocations for instance 504ea112-b5b7-4b2c-8962-e842eb87b294
Oct 24 00:03:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-954f3080-abf4-463b-9fdb-4da3d78a1ae1 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "504ea112-b5b7-4b2c-8962-e842eb87b294" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.434s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:03:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:03:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:04:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:04:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:04:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:04:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:04:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:04:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:04:18 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:04:18 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:04:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:04:19 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:04:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=24.916553497314453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:04:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance d5cb9185-750f-4827-98e9-5b7d99d5081e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:04:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:04:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:04:19 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:04:19 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:04:19 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:04:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:04:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:04:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:04:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:04:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:04:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:04:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:04:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "d5cb9185-750f-4827-98e9-5b7d99d5081e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:04:46 user nova-compute[74482]: INFO nova.compute.manager [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Terminating instance
Oct 24 00:04:46 user nova-compute[74482]: DEBUG nova.compute.manager [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-1ca7e2c8-6caf-4a2f-9778-8ce3b6d8875f req-9ae1d347-c804-4bc4-b296-cb0319e89fd6 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received event network-vif-unplugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1ca7e2c8-6caf-4a2f-9778-8ce3b6d8875f req-9ae1d347-c804-4bc4-b296-cb0319e89fd6 service nova] Acquiring lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1ca7e2c8-6caf-4a2f-9778-8ce3b6d8875f req-9ae1d347-c804-4bc4-b296-cb0319e89fd6 service nova] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1ca7e2c8-6caf-4a2f-9778-8ce3b6d8875f req-9ae1d347-c804-4bc4-b296-cb0319e89fd6 service nova] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-1ca7e2c8-6caf-4a2f-9778-8ce3b6d8875f req-9ae1d347-c804-4bc4-b296-cb0319e89fd6 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] No waiting events found dispatching network-vif-unplugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:04:46 user nova-compute[74482]: DEBUG nova.compute.manager [req-1ca7e2c8-6caf-4a2f-9778-8ce3b6d8875f req-9ae1d347-c804-4bc4-b296-cb0319e89fd6 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received event network-vif-unplugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Instance destroyed successfully.
Oct 24 00:04:47 user nova-compute[74482]: DEBUG nova.objects.instance [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'resources' on Instance uuid d5cb9185-750f-4827-98e9-5b7d99d5081e {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T23:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-232481457',display_name='tempest-TestVolumeBootPattern-volume-backed-server-232481457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-232481457',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHonjoRH8POI7Eok/qVOWhbdT9r7Y6sRfCyDgQ5wuirZ2FSmKRg0RtUF09iHvua+DorHIzuNkiasOkDHT92FxJF2kDQ9P3RbXyk9qot0F1QKIfc+oKq0P3+1G4n5ZS6G+Q==',key_name='tempest-keypair-967657175',keypairs=<?>,launch_index=0,launched_at=2023-10-24T00:00:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-jf475c81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-24T00:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab7adbba189645ecb67794b738c87db1',uuid=d5cb9185-750f-4827-98e9-5b7d99d5081e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "address": "fa:16:3e:36:25:14", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap479b82fc-7d", "ovs_interfaceid": "479b82fc-7d95-4c52-a493-b9c27302b9e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:25:14,bridge_name='br-int',has_traffic_filtering=True,id=479b82fc-7d95-4c52-a493-b9c27302b9e5,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479b82fc-7d') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_vif [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:25:14,bridge_name='br-int',has_traffic_filtering=True,id=479b82fc-7d95-4c52-a493-b9c27302b9e5,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479b82fc-7d') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap479b82fc-7d, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b43425b-7cfc-4343-98e1-855544d39dac) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:04:47 user nova-compute[74482]: INFO os_vif [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:25:14,bridge_name='br-int',has_traffic_filtering=True,id=479b82fc-7d95-4c52-a493-b9c27302b9e5,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479b82fc-7d')
Oct 24 00:04:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CaAcOpIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:04:47 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f541c1-b7a0-4c7b-bb9b-050e4478e3f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 24 00:04:47 user nova-compute[74482]: No targets found.
Oct 24 00:04:47 user nova-compute[74482]: iSNS:
Oct 24 00:04:47 user nova-compute[74482]: No targets found.
Oct 24 00:04:47 user nova-compute[74482]: STATIC:
Oct 24 00:04:47 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800
Oct 24 00:04:47 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:04:47 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:04:47 user nova-compute[74482]: FIRMWARE:
Oct 24 00:04:47 user nova-compute[74482]: No targets found.
Oct 24 00:04:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 24 00:04:47 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 24 00:04:47 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a0eb73-1032-4593-a146-42038f36bdae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ed2c40-d2be-40e3-9476-c3ca2e19e9f8]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:04:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 (non-flash)
Oct 24 00:04:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c635900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c41f7f-339c-451b-8cb1-f586ec8b6816]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8be33f6-18c9-4e74-869e-352e203e549d]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a203feb-adcc-429b-842a-e25a3b71a24f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c6df82-b804-48d5-a8fd-51cff2bf2b31]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_423c218', '/dev/disk/by-id/scsi-1SCST_BIO423c218-d7a91f163f2d90e3', '/dev/disk/by-id/scsi-26437613931663136') {{(pid=86306) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f664df2d-fe1e-4fbd-99e8-f255d2ef9d18]: (4, None) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec68ec9-652c-4e81-9d26-2f871edcdf4f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e8930e-96a0-46f8-8e35-cb3e2f502579]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800, portal: 172.16.0.220,3260]
Oct 24 00:04:47 user nova-compute[74482]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800, portal: 172.16.0.220,3260] successful.
Oct 24 00:04:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d394698-4819-4b77-a188-deff3fae3800 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[918d4f25-1f99-4786-a272-e31c61251e86]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== disconnect_volume: return (285ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 24 00:04:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Deleting instance files /opt/stack/data/nova/instances/d5cb9185-750f-4827-98e9-5b7d99d5081e_del
Oct 24 00:04:47 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Deletion of /opt/stack/data/nova/instances/d5cb9185-750f-4827-98e9-5b7d99d5081e_del complete
Oct 24 00:04:47 user nova-compute[74482]: INFO nova.compute.manager [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Took 1.12 seconds to destroy the instance on the hypervisor.
Oct 24 00:04:47 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 24 00:04:47 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 24 00:04:48 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:04:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-cb49463d-3e9e-4be2-9ab0-d8e6dc121d8f req-d75dd254-f3ae-424f-be49-94f7cc206281 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received event network-vif-deleted-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:04:48 user nova-compute[74482]: INFO nova.compute.manager [req-cb49463d-3e9e-4be2-9ab0-d8e6dc121d8f req-d75dd254-f3ae-424f-be49-94f7cc206281 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Neutron deleted interface 479b82fc-7d95-4c52-a493-b9c27302b9e5; detaching it from the instance and deleting it from the info cache
Oct 24 00:04:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-cb49463d-3e9e-4be2-9ab0-d8e6dc121d8f req-d75dd254-f3ae-424f-be49-94f7cc206281 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:04:48 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Took 0.83 seconds to deallocate network for instance.
Oct 24 00:04:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-cb49463d-3e9e-4be2-9ab0-d8e6dc121d8f req-d75dd254-f3ae-424f-be49-94f7cc206281 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Detach interface failed, port_id=479b82fc-7d95-4c52-a493-b9c27302b9e5, reason: Instance d5cb9185-750f-4827-98e9-5b7d99d5081e could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 24 00:04:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-4ead3ae7-4803-4a99-b20f-5524fc060908 req-2bd10d26-67df-4044-8c72-a1a599f52217 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received event network-vif-plugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:04:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ead3ae7-4803-4a99-b20f-5524fc060908 req-2bd10d26-67df-4044-8c72-a1a599f52217 service nova] Acquiring lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:04:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ead3ae7-4803-4a99-b20f-5524fc060908 req-2bd10d26-67df-4044-8c72-a1a599f52217 service nova] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:04:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4ead3ae7-4803-4a99-b20f-5524fc060908 req-2bd10d26-67df-4044-8c72-a1a599f52217 service nova] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:04:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-4ead3ae7-4803-4a99-b20f-5524fc060908 req-2bd10d26-67df-4044-8c72-a1a599f52217 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] No waiting events found dispatching network-vif-plugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:04:48 user nova-compute[74482]: WARNING nova.compute.manager [req-4ead3ae7-4803-4a99-b20f-5524fc060908 req-2bd10d26-67df-4044-8c72-a1a599f52217 service nova] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Received unexpected event network-vif-plugged-479b82fc-7d95-4c52-a493-b9c27302b9e5 for instance with vm_state active and task_state deleting.
Oct 24 00:04:49 user nova-compute[74482]: INFO nova.compute.manager [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Took 0.77 seconds to detach 1 volumes for instance.
Oct 24 00:04:49 user nova-compute[74482]: DEBUG nova.compute.manager [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: d5cb9185-750f-4827-98e9-5b7d99d5081e] Deleting volume: 8d394698-4819-4b77-a188-deff3fae3800 {{(pid=74482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 24 00:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:04:49 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:04:49 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:04:49 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Deleted allocations for instance d5cb9185-750f-4827-98e9-5b7d99d5081e
Oct 24 00:04:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-64cc5a9a-0551-4b1d-ab1f-6b6da7834530 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "d5cb9185-750f-4827-98e9-5b7d99d5081e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.133s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:04:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:04:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:00 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:05:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:05:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:05:00 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:05:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:05:01 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:05:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:05:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:05:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:05:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:05:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:05:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:05:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:05:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:05:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:05:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:05:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:05:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:05:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=24.915721893310547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:05:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:05:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:05:21 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:05:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:05:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:05:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:05:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:05:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:05:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:05:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:05:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:05:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:05:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:05:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:05:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "e895c870-b0c9-4752-8ada-de0816f02c95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:05:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "e895c870-b0c9-4752-8ada-de0816f02c95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:05:55 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 24 00:05:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:05:55 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:05:55 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 24 00:05:55 user nova-compute[74482]: INFO nova.compute.claims [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Claim successful on node user
Oct 24 00:05:56 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 24 00:05:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 24 00:05:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG nova.policy [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7adbba189645ecb67794b738c87db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1bcbe0d3b94e158cc20c6905b80f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 24 00:05:56 user nova-compute[74482]: INFO nova.virt.block_device [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Booting with volume e3c55a44-0c00-4146-a742-3fd1c0bddc87 at /dev/vda
Oct 24 00:05:56 user nova-compute[74482]: DEBUG os_brick.utils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[574ede1f-7751-4fb3-944f-c373445f6018]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[630ad6c4-2b68-46ef-948d-81423ba86962]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e785b46a-985e-4d54-838a-4c32c05137a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b826e3-1422-46c0-9079-b0d907ac8fdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:05:56 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 24 00:05:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba02d1a-9be3-4e56-be01-9b4fe2c9a406]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG os_brick.utils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Updating existing volume attachment record: 8787d658-97c6-4d89-821f-e639daa5277c {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 24 00:05:56 user nova-compute[74482]: DEBUG nova.network.neutron [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Successfully created port: 0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG nova.network.neutron [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Successfully updated port: 0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquired lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG nova.network.neutron [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-e47372f8-2d12-483a-9f44-b3b26a8cc81f req-eb80e75c-d1a9-4a61-9df2-4b38121c2112 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received event network-changed-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG nova.compute.manager [req-e47372f8-2d12-483a-9f44-b3b26a8cc81f req-eb80e75c-d1a9-4a61-9df2-4b38121c2112 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Refreshing instance network info cache due to event network-changed-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e47372f8-2d12-483a-9f44-b3b26a8cc81f req-eb80e75c-d1a9-4a61-9df2-4b38121c2112 service nova] Acquiring lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG nova.network.neutron [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG nova.network.neutron [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Updating instance_info_cache with network_info: [{"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Releasing lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Instance network_info: |[{"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e47372f8-2d12-483a-9f44-b3b26a8cc81f req-eb80e75c-d1a9-4a61-9df2-4b38121c2112 service nova] Acquired lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:05:57 user nova-compute[74482]: DEBUG nova.network.neutron [req-e47372f8-2d12-483a-9f44-b3b26a8cc81f req-eb80e75c-d1a9-4a61-9df2-4b38121c2112 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Refreshing network info cache for port 0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:05:58 user nova-compute[74482]: DEBUG nova.network.neutron [req-e47372f8-2d12-483a-9f44-b3b26a8cc81f req-eb80e75c-d1a9-4a61-9df2-4b38121c2112 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Updated VIF entry in instance network info cache for port 0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:05:58 user nova-compute[74482]: DEBUG nova.network.neutron [req-e47372f8-2d12-483a-9f44-b3b26a8cc81f req-eb80e75c-d1a9-4a61-9df2-4b38121c2112 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Updating instance_info_cache with network_info: [{"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:05:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-e47372f8-2d12-483a-9f44-b3b26a8cc81f req-eb80e75c-d1a9-4a61-9df2-4b38121c2112 service nova] Releasing lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:06:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:06:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:06:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:06:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Skipping network cache update for instance because it is Building. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 24 00:06:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:06:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:06:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:06:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 24 00:06:12 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Creating image(s)
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Ensure instance console log exists: /opt/stack/data/nova/instances/e895c870-b0c9-4752-8ada-de0816f02c95/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Start _get_guest_xml network_info=[{"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMBkfrdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e895c870-b0c9-4752-8ada-de0816f02c95', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'serial': 'e3c55a44-0c00-4146-a742-3fd1c0bddc87'}, 'disk_bus': 'virtio', 'attachment_id': '8787d658-97c6-4d89-821f-e639daa5277c', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 24 00:06:12 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:06:12 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMBkfrdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:06:12 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:06:12 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:06:12 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 24 00:06:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0933ce9d-5d65-409c-9d75-2da72d44f225]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 24 00:06:12 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[863410ba-bb9c-456f-9508-c3f4746ecf3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87] added
Oct 24 00:06:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[af65f4da-8a01-4b9c-8934-01eefbc8fb4d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bd74d4-3df2-40f1-92b6-e3022245f5d7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMBkfrdV {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMBkfrdV" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44f3e88-a061-47f1-b540-5f8d804ab1e9]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sMBkfrdV'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96712b74-b1a2-4032-8e5c-afc12cfba5f7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[946bb858-7f2d-4862-b896-6127c3944eed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:06:12 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:06:12 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:06:12 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 24 00:06:12 user nova-compute[74482]: 
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7fe60d-925e-4f5b-9b12-71bc4324dfe8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260]
Oct 24 00:06:12 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260] successful.
Oct 24 00:06:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[81980043-7942-4828-b954-567641059289]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[729d29f5-69f9-48aa-866b-dbc42fcd4724]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:06:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:06:12 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fb0725-5f68-4165-92d9-2c583a3ddeab]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:06:12 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMBkfrdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23661383831633665', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661383831633665', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1158472677',display_name='tempest-TestVolumeBootPattern-server-1158472677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1158472677',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFenSApZzr38aeVgwUFTcOFD9ye7qHMwMxmPxmttUPlVvePAAp4GN9mIygYjyr+hZYwre2qJ8M/Npq7c+l3v5A1qjZC5UiEOm16SDEq0ZjONZr1P2+8/aH2nSeJsef2Zg==',key_name='tempest-TestVolumeBootPattern-160083005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-u5855j05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:05:56Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=e895c870-b0c9-4752-8ada-de0816f02c95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d2:66,bridge_name='br-int',has_traffic_filtering=True,id=0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3eb72b-e0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.objects.instance [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'pci_devices' on Instance uuid e895c870-b0c9-4752-8ada-de0816f02c95 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] End _get_guest_xml xml=<domain type="kvm">
Oct 24 00:06:13 user nova-compute[74482]:   <uuid>e895c870-b0c9-4752-8ada-de0816f02c95</uuid>
Oct 24 00:06:13 user nova-compute[74482]:   <name>instance-00000032</name>
Oct 24 00:06:13 user nova-compute[74482]:   <memory>524288</memory>
Oct 24 00:06:13 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 24 00:06:13 user nova-compute[74482]:   <metadata>
Oct 24 00:06:13 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 24 00:06:13 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 24 00:06:13 user nova-compute[74482]:       <nova:name>tempest-TestVolumeBootPattern-server-1158472677</nova:name>
Oct 24 00:06:13 user nova-compute[74482]:       <nova:creationTime>2023-10-24 00:06:12</nova:creationTime>
Oct 24 00:06:13 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 24 00:06:13 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 24 00:06:13 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 24 00:06:13 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 24 00:06:13 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 24 00:06:13 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 24 00:06:13 user nova-compute[74482]:       </nova:flavor>
Oct 24 00:06:13 user nova-compute[74482]:       <nova:owner>
Oct 24 00:06:13 user nova-compute[74482]:         <nova:user uuid="ab7adbba189645ecb67794b738c87db1">tempest-TestVolumeBootPattern-334654437-project-member</nova:user>
Oct 24 00:06:13 user nova-compute[74482]:         <nova:project uuid="bd1bcbe0d3b94e158cc20c6905b80f13">tempest-TestVolumeBootPattern-334654437</nova:project>
Oct 24 00:06:13 user nova-compute[74482]:       </nova:owner>
Oct 24 00:06:13 user nova-compute[74482]:       <nova:ports>
Oct 24 00:06:13 user nova-compute[74482]:         <nova:port uuid="0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f">
Oct 24 00:06:13 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 24 00:06:13 user nova-compute[74482]:         </nova:port>
Oct 24 00:06:13 user nova-compute[74482]:       </nova:ports>
Oct 24 00:06:13 user nova-compute[74482]:     </nova:instance>
Oct 24 00:06:13 user nova-compute[74482]:   </metadata>
Oct 24 00:06:13 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 24 00:06:13 user nova-compute[74482]:     <system>
Oct 24 00:06:13 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 24 00:06:13 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 24 00:06:13 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 24 00:06:13 user nova-compute[74482]:       <entry name="serial">e895c870-b0c9-4752-8ada-de0816f02c95</entry>
Oct 24 00:06:13 user nova-compute[74482]:       <entry name="uuid">e895c870-b0c9-4752-8ada-de0816f02c95</entry>
Oct 24 00:06:13 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 24 00:06:13 user nova-compute[74482]:     </system>
Oct 24 00:06:13 user nova-compute[74482]:   </sysinfo>
Oct 24 00:06:13 user nova-compute[74482]:   <os>
Oct 24 00:06:13 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 24 00:06:13 user nova-compute[74482]:     <boot dev="hd"/>
Oct 24 00:06:13 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 24 00:06:13 user nova-compute[74482]:   </os>
Oct 24 00:06:13 user nova-compute[74482]:   <features>
Oct 24 00:06:13 user nova-compute[74482]:     <acpi/>
Oct 24 00:06:13 user nova-compute[74482]:     <apic/>
Oct 24 00:06:13 user nova-compute[74482]:     <vmcoreinfo/>
Oct 24 00:06:13 user nova-compute[74482]:   </features>
Oct 24 00:06:13 user nova-compute[74482]:   <clock offset="utc">
Oct 24 00:06:13 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 24 00:06:13 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 24 00:06:13 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 24 00:06:13 user nova-compute[74482]:   </clock>
Oct 24 00:06:13 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 24 00:06:13 user nova-compute[74482]:     <model>Nehalem</model>
Oct 24 00:06:13 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 24 00:06:13 user nova-compute[74482]:   </cpu>
Oct 24 00:06:13 user nova-compute[74482]:   <devices>
Oct 24 00:06:13 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 24 00:06:13 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:06:13 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 24 00:06:13 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 24 00:06:13 user nova-compute[74482]:       <serial>e3c55a44-0c00-4146-a742-3fd1c0bddc87</serial>
Oct 24 00:06:13 user nova-compute[74482]:     </disk>
Oct 24 00:06:13 user nova-compute[74482]:     <interface type="ethernet">
Oct 24 00:06:13 user nova-compute[74482]:       <mac address="fa:16:3e:b2:d2:66"/>
Oct 24 00:06:13 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:06:13 user nova-compute[74482]:       <mtu size="1442"/>
Oct 24 00:06:13 user nova-compute[74482]:       <target dev="tap0d3eb72b-e0"/>
Oct 24 00:06:13 user nova-compute[74482]:     </interface>
Oct 24 00:06:13 user nova-compute[74482]:     <serial type="pty">
Oct 24 00:06:13 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/e895c870-b0c9-4752-8ada-de0816f02c95/console.log" append="off"/>
Oct 24 00:06:13 user nova-compute[74482]:     </serial>
Oct 24 00:06:13 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 24 00:06:13 user nova-compute[74482]:     <video>
Oct 24 00:06:13 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:06:13 user nova-compute[74482]:     </video>
Oct 24 00:06:13 user nova-compute[74482]:     <rng model="virtio">
Oct 24 00:06:13 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 24 00:06:13 user nova-compute[74482]:     </rng>
Oct 24 00:06:13 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 24 00:06:13 user nova-compute[74482]:     <memballoon model="virtio">
Oct 24 00:06:13 user nova-compute[74482]:       <stats period="10"/>
Oct 24 00:06:13 user nova-compute[74482]:     </memballoon>
Oct 24 00:06:13 user nova-compute[74482]:   </devices>
Oct 24 00:06:13 user nova-compute[74482]: </domain>
Oct 24 00:06:13 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1158472677',display_name='tempest-TestVolumeBootPattern-server-1158472677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1158472677',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFenSApZzr38aeVgwUFTcOFD9ye7qHMwMxmPxmttUPlVvePAAp4GN9mIygYjyr+hZYwre2qJ8M/Npq7c+l3v5A1qjZC5UiEOm16SDEq0ZjONZr1P2+8/aH2nSeJsef2Zg==',key_name='tempest-TestVolumeBootPattern-160083005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-u5855j05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:05:56Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=e895c870-b0c9-4752-8ada-de0816f02c95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d2:66,bridge_name='br-int',has_traffic_filtering=True,id=0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3eb72b-e0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG os_vif [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d2:66,bridge_name='br-int',has_traffic_filtering=True,id=0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3eb72b-e0') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8257317-fd8d-500a-835f-a45c0e1de677', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d3eb72b-e0, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d3eb72b-e0, col_values=(('qos', UUID('76cdd1e1-a98b-45d3-b280-13f362898939')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d3eb72b-e0, col_values=(('external_ids', {'iface-id': '0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:d2:66', 'vm-uuid': 'e895c870-b0c9-4752-8ada-de0816f02c95'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:13 user nova-compute[74482]: INFO os_vif [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d2:66,bridge_name='br-int',has_traffic_filtering=True,id=0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3eb72b-e0')
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:06:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No VIF found with MAC fa:16:3e:b2:d2:66, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-4770c236-92df-4875-908f-9a6c95c5cfcc req-1fcd25e8-1359-4f80-aa2c-99419097fa98 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received event network-vif-plugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4770c236-92df-4875-908f-9a6c95c5cfcc req-1fcd25e8-1359-4f80-aa2c-99419097fa98 service nova] Acquiring lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4770c236-92df-4875-908f-9a6c95c5cfcc req-1fcd25e8-1359-4f80-aa2c-99419097fa98 service nova] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-4770c236-92df-4875-908f-9a6c95c5cfcc req-1fcd25e8-1359-4f80-aa2c-99419097fa98 service nova] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG nova.compute.manager [req-4770c236-92df-4875-908f-9a6c95c5cfcc req-1fcd25e8-1359-4f80-aa2c-99419097fa98 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] No waiting events found dispatching network-vif-plugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:06:15 user nova-compute[74482]: WARNING nova.compute.manager [req-4770c236-92df-4875-908f-9a6c95c5cfcc req-1fcd25e8-1359-4f80-aa2c-99419097fa98 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received unexpected event network-vif-plugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f for instance with vm_state building and task_state spawning.
Oct 24 00:06:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 24 00:06:17 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Instance spawned successfully.
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:06:17 user nova-compute[74482]: INFO nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Took 5.11 seconds to spawn the instance on the hypervisor.
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 24 00:06:17 user nova-compute[74482]: INFO nova.compute.manager [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Took 21.68 seconds to build instance.
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-6da74ee8-9133-48e5-aef3-2806bf01160e req-2f924498-337b-46f8-a193-69b42ff401db service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received event network-vif-plugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6da74ee8-9133-48e5-aef3-2806bf01160e req-2f924498-337b-46f8-a193-69b42ff401db service nova] Acquiring lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6da74ee8-9133-48e5-aef3-2806bf01160e req-2f924498-337b-46f8-a193-69b42ff401db service nova] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-6da74ee8-9133-48e5-aef3-2806bf01160e req-2f924498-337b-46f8-a193-69b42ff401db service nova] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:06:17 user nova-compute[74482]: DEBUG nova.compute.manager [req-6da74ee8-9133-48e5-aef3-2806bf01160e req-2f924498-337b-46f8-a193-69b42ff401db service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] No waiting events found dispatching network-vif-plugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:06:17 user nova-compute[74482]: WARNING nova.compute.manager [req-6da74ee8-9133-48e5-aef3-2806bf01160e req-2f924498-337b-46f8-a193-69b42ff401db service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received unexpected event network-vif-plugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f for instance with vm_state active and task_state None.
Oct 24 00:06:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-6b235903-faf8-4821-91ff-0c36097bd55e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "e895c870-b0c9-4752-8ada-de0816f02c95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.784s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:06:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_power_states {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Triggering sync for uuid e895c870-b0c9-4752-8ada-de0816f02c95 {{(pid=74482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "e895c870-b0c9-4752-8ada-de0816f02c95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "e895c870-b0c9-4752-8ada-de0816f02c95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "e895c870-b0c9-4752-8ada-de0816f02c95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:06:20 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:06:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:06:21 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=24.91358184814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e895c870-b0c9-4752-8ada-de0816f02c95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:06:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:06:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:26 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 24 00:06:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:06:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:06:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:06:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:06:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:06:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:06:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:07:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:07:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:07:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:07:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:07:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:07:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:07:02 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid e895c870-b0c9-4752-8ada-de0816f02c95 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:07:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Updating instance_info_cache with network_info: [{"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:07:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:07:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:07:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:07:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:07:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:07:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:07:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:07:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:07:11 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:07:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:07:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:07:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:07:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:07:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:07:21 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:07:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:07:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:07:22 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:07:22 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=24.912906646728516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:07:22 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance e895c870-b0c9-4752-8ada-de0816f02c95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:07:22 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:07:22 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:07:22 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:07:22 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:07:22 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:07:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:07:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:07:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:07:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:07:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-1651e5ee-2f0b-46ea-b500-507946187eaa req-09f6aecc-6c1b-4b73-8081-60ed01913886 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received event network-changed-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:07:47 user nova-compute[74482]: DEBUG nova.compute.manager [req-1651e5ee-2f0b-46ea-b500-507946187eaa req-09f6aecc-6c1b-4b73-8081-60ed01913886 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Refreshing instance network info cache due to event network-changed-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1651e5ee-2f0b-46ea-b500-507946187eaa req-09f6aecc-6c1b-4b73-8081-60ed01913886 service nova] Acquiring lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:07:47 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1651e5ee-2f0b-46ea-b500-507946187eaa req-09f6aecc-6c1b-4b73-8081-60ed01913886 service nova] Acquired lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:07:47 user nova-compute[74482]: DEBUG nova.network.neutron [req-1651e5ee-2f0b-46ea-b500-507946187eaa req-09f6aecc-6c1b-4b73-8081-60ed01913886 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Refreshing network info cache for port 0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "e895c870-b0c9-4752-8ada-de0816f02c95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "e895c870-b0c9-4752-8ada-de0816f02c95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:07:48 user nova-compute[74482]: INFO nova.compute.manager [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Terminating instance
Oct 24 00:07:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-c4173698-aaa3-4761-b622-567985b35093 req-da942360-1e0f-4c41-9027-9a28fbf00adb service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received event network-vif-unplugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c4173698-aaa3-4761-b622-567985b35093 req-da942360-1e0f-4c41-9027-9a28fbf00adb service nova] Acquiring lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c4173698-aaa3-4761-b622-567985b35093 req-da942360-1e0f-4c41-9027-9a28fbf00adb service nova] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c4173698-aaa3-4761-b622-567985b35093 req-da942360-1e0f-4c41-9027-9a28fbf00adb service nova] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-c4173698-aaa3-4761-b622-567985b35093 req-da942360-1e0f-4c41-9027-9a28fbf00adb service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] No waiting events found dispatching network-vif-unplugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG nova.compute.manager [req-c4173698-aaa3-4761-b622-567985b35093 req-da942360-1e0f-4c41-9027-9a28fbf00adb service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received event network-vif-unplugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-1651e5ee-2f0b-46ea-b500-507946187eaa req-09f6aecc-6c1b-4b73-8081-60ed01913886 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Updated VIF entry in instance network info cache for port 0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG nova.network.neutron [req-1651e5ee-2f0b-46ea-b500-507946187eaa req-09f6aecc-6c1b-4b73-8081-60ed01913886 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Updating instance_info_cache with network_info: [{"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1651e5ee-2f0b-46ea-b500-507946187eaa req-09f6aecc-6c1b-4b73-8081-60ed01913886 service nova] Releasing lock "refresh_cache-e895c870-b0c9-4752-8ada-de0816f02c95" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:07:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:49 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Instance destroyed successfully.
Oct 24 00:07:49 user nova-compute[74482]: DEBUG nova.objects.instance [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'resources' on Instance uuid e895c870-b0c9-4752-8ada-de0816f02c95 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1158472677',display_name='tempest-TestVolumeBootPattern-server-1158472677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1158472677',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFenSApZzr38aeVgwUFTcOFD9ye7qHMwMxmPxmttUPlVvePAAp4GN9mIygYjyr+hZYwre2qJ8M/Npq7c+l3v5A1qjZC5UiEOm16SDEq0ZjONZr1P2+8/aH2nSeJsef2Zg==',key_name='tempest-TestVolumeBootPattern-160083005',keypairs=<?>,launch_index=0,launched_at=2023-10-24T00:06:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-u5855j05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-24T00:06:18Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=e895c870-b0c9-4752-8ada-de0816f02c95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "address": "fa:16:3e:b2:d2:66", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d3eb72b-e0", "ovs_interfaceid": "0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d2:66,bridge_name='br-int',has_traffic_filtering=True,id=0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3eb72b-e0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_vif [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d2:66,bridge_name='br-int',has_traffic_filtering=True,id=0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3eb72b-e0') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d3eb72b-e0, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76cdd1e1-a98b-45d3-b280-13f362898939) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:49 user nova-compute[74482]: INFO os_vif [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d2:66,bridge_name='br-int',has_traffic_filtering=True,id=0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d3eb72b-e0')
Oct 24 00:07:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMBkfrdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:07:49 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c53410-aea5-49bc-bb5a-498e2a60cf62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 24 00:07:49 user nova-compute[74482]: No targets found.
Oct 24 00:07:49 user nova-compute[74482]: iSNS:
Oct 24 00:07:49 user nova-compute[74482]: No targets found.
Oct 24 00:07:49 user nova-compute[74482]: STATIC:
Oct 24 00:07:49 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87
Oct 24 00:07:49 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:07:49 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:07:49 user nova-compute[74482]: FIRMWARE:
Oct 24 00:07:49 user nova-compute[74482]: No targets found.
Oct 24 00:07:49 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 24 00:07:49 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 24 00:07:49 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e962dc-b477-49db-aa7a-a4701f4f0839]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc428eda-d4d1-47b2-9b62-3dbc209b4646]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:07:49 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:07:49 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c442e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb63290-3ff1-4c15-a4dd-ed1ad3f58513]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c65445-f538-4a25-9c63-087622f1aae2]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3540f9-472f-44c8-93bf-d95011aec31c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb038ab-fee1-430c-933a-54533a49a1fb]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe067fad6-6a881c6eda38f047', '/dev/disk/by-id/scsi-23661383831633665', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e067fad6') {{(pid=86306) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fab5aa-bda2-42aa-b99c-db76b4393f9d]: (4, None) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59fd32a-84e8-40de-bd06-66c18ab3fc5a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a68d4a-7000-4d30-b159-0b06c03c4d1a]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260]
Oct 24 00:07:49 user nova-compute[74482]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260] successful.
Oct 24 00:07:49 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee38472d-24b9-4ecb-a9f2-e72ef88afd19]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== disconnect_volume: return (298ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 24 00:07:49 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Deleting instance files /opt/stack/data/nova/instances/e895c870-b0c9-4752-8ada-de0816f02c95_del
Oct 24 00:07:49 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Deletion of /opt/stack/data/nova/instances/e895c870-b0c9-4752-8ada-de0816f02c95_del complete
Oct 24 00:07:49 user nova-compute[74482]: INFO nova.compute.manager [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 24 00:07:49 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 24 00:07:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:50 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:07:50 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Took 0.68 seconds to deallocate network for instance.
Oct 24 00:07:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-e1248618-436f-4673-8e8f-a9a99aca665f req-345a2605-d25b-47a2-8c0f-f75921617616 service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received event network-vif-deleted-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:07:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-2c97e570-e58d-472d-96dd-10aa4bcc4019 req-24f947bc-ef80-4e0e-9d66-3525d9c2d7cd service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received event network-vif-plugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:07:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2c97e570-e58d-472d-96dd-10aa4bcc4019 req-24f947bc-ef80-4e0e-9d66-3525d9c2d7cd service nova] Acquiring lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:07:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2c97e570-e58d-472d-96dd-10aa4bcc4019 req-24f947bc-ef80-4e0e-9d66-3525d9c2d7cd service nova] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:07:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2c97e570-e58d-472d-96dd-10aa4bcc4019 req-24f947bc-ef80-4e0e-9d66-3525d9c2d7cd service nova] Lock "e895c870-b0c9-4752-8ada-de0816f02c95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:07:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-2c97e570-e58d-472d-96dd-10aa4bcc4019 req-24f947bc-ef80-4e0e-9d66-3525d9c2d7cd service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] No waiting events found dispatching network-vif-plugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:07:50 user nova-compute[74482]: WARNING nova.compute.manager [req-2c97e570-e58d-472d-96dd-10aa4bcc4019 req-24f947bc-ef80-4e0e-9d66-3525d9c2d7cd service nova] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Received unexpected event network-vif-plugged-0d3eb72b-e0a8-4f69-b5fa-c59e7b5a829f for instance with vm_state active and task_state deleting.
Oct 24 00:07:51 user nova-compute[74482]: INFO nova.compute.manager [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: e895c870-b0c9-4752-8ada-de0816f02c95] Took 0.78 seconds to detach 1 volumes for instance.
Oct 24 00:07:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:07:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:07:51 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:07:51 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:07:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:07:51 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Deleted allocations for instance e895c870-b0c9-4752-8ada-de0816f02c95
Oct 24 00:07:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-d589b152-5764-426e-b1f8-fba05bd14a63 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "e895c870-b0c9-4752-8ada-de0816f02c95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.110s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:07:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:07:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:07:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:07:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:07:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:07:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:03 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:08:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:08:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:08:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:08:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:08:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:08:22 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:08:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:08:23 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:08:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9096MB free_disk=24.912097930908203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:08:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:08:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:08:23 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:08:23 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:08:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:08:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:08:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:08:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:08:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:08:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:08:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "219dee94-e238-4f09-be21-f5c05ea2cd41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 24 00:08:40 user nova-compute[74482]: INFO nova.compute.claims [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Claim successful on node user
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 24 00:08:40 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 24 00:08:40 user nova-compute[74482]: INFO nova.virt.block_device [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Booting with volume e3c55a44-0c00-4146-a742-3fd1c0bddc87 at /dev/vda
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.policy [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7adbba189645ecb67794b738c87db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1bcbe0d3b94e158cc20c6905b80f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG os_brick.utils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacb3350-18b7-4311-b218-8ea9d339f752]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa55587e-43ab-4f80-a325-24b661265a08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e34179-23d7-42a5-b296-58036be4e2ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d17421-8e8d-4ab8-a199-fb7734df9a76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:08:40 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 24 00:08:40 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a572e1ad-9e40-44c0-9653-fb416bec27be]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG os_brick.utils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:08:40 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating existing volume attachment record: 7740af5c-224b-467c-8e9a-ce0fb88ce7ca {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 24 00:08:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Successfully created port: da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 24 00:08:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Successfully updated port: da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 24 00:08:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:08:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquired lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:08:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 24 00:08:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-49045e06-2329-4202-b619-83b596076c9b req-586cb392-baaa-4f0e-8015-7827992929b3 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received event network-changed-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:08:41 user nova-compute[74482]: DEBUG nova.compute.manager [req-49045e06-2329-4202-b619-83b596076c9b req-586cb392-baaa-4f0e-8015-7827992929b3 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Refreshing instance network info cache due to event network-changed-da87dbc1-f3b0-4aca-8efc-ae479828001f. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:08:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49045e06-2329-4202-b619-83b596076c9b req-586cb392-baaa-4f0e-8015-7827992929b3 service nova] Acquiring lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:08:41 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 24 00:08:42 user nova-compute[74482]: DEBUG nova.network.neutron [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:08:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Releasing lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:08:42 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Instance network_info: |[{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 24 00:08:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49045e06-2329-4202-b619-83b596076c9b req-586cb392-baaa-4f0e-8015-7827992929b3 service nova] Acquired lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:08:42 user nova-compute[74482]: DEBUG nova.network.neutron [req-49045e06-2329-4202-b619-83b596076c9b req-586cb392-baaa-4f0e-8015-7827992929b3 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Refreshing network info cache for port da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:08:42 user nova-compute[74482]: DEBUG nova.network.neutron [req-49045e06-2329-4202-b619-83b596076c9b req-586cb392-baaa-4f0e-8015-7827992929b3 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updated VIF entry in instance network info cache for port da87dbc1-f3b0-4aca-8efc-ae479828001f. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:08:42 user nova-compute[74482]: DEBUG nova.network.neutron [req-49045e06-2329-4202-b619-83b596076c9b req-586cb392-baaa-4f0e-8015-7827992929b3 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:08:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-49045e06-2329-4202-b619-83b596076c9b req-586cb392-baaa-4f0e-8015-7827992929b3 service nova] Releasing lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:08:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:08:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:08:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:08:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 24 00:08:56 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Creating image(s)
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Ensure instance console log exists: /opt/stack/data/nova/instances/219dee94-e238-4f09-be21-f5c05ea2cd41/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Start _get_guest_xml network_info=[{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMBkfrdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '219dee94-e238-4f09-be21-f5c05ea2cd41', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'serial': 'e3c55a44-0c00-4146-a742-3fd1c0bddc87'}, 'disk_bus': 'virtio', 'attachment_id': '7740af5c-224b-467c-8e9a-ce0fb88ce7ca', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 24 00:08:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:08:56 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMBkfrdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:08:56 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:08:56 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:08:56 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f80688-2e3c-40ab-9ce0-b624805f4a30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 24 00:08:56 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[28714924-8e3c-457e-a379-22c947f036bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87] added
Oct 24 00:08:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[586516d5-942d-4ec7-b321-44cc69aca407]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e3bd9-b27f-4d48-ac3b-8788da007c0c]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMBkfrdV {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMBkfrdV" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[146a7501-9676-45a9-b427-718075bd261e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sMBkfrdV'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[41067e48-93d9-4aae-afad-57ec62c10ae8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[68187262-7e8c-4e60-a457-a59e81611323]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:08:56 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:08:56 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:08:56 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 24 00:08:56 user nova-compute[74482]: 
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3253ef3-896f-4a73-ab4d-b1031397a90e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260]
Oct 24 00:08:56 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260] successful.
Oct 24 00:08:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fed0817-f64c-4a6d-85ff-87ac22c339a8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[78582725-024d-4aef-88af-58bebf597d91]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:08:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:08:56 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76d555f-b669-4cf6-ab38-7eeb9a763a61]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:08:56 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMBkfrdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23661383831633665', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661383831633665', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-471025606',display_name='tempest-TestVolumeBootPattern-server-471025606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-471025606',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFenSApZzr38aeVgwUFTcOFD9ye7qHMwMxmPxmttUPlVvePAAp4GN9mIygYjyr+hZYwre2qJ8M/Npq7c+l3v5A1qjZC5UiEOm16SDEq0ZjONZr1P2+8/aH2nSeJsef2Zg==',key_name='tempest-TestVolumeBootPattern-160083005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-06pzr0nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:08:41Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=219dee94-e238-4f09-be21-f5c05ea2cd41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:93:a0,bridge_name='br-int',has_traffic_filtering=True,id=da87dbc1-f3b0-4aca-8efc-ae479828001f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda87dbc1-f3') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'pci_devices' on Instance uuid 219dee94-e238-4f09-be21-f5c05ea2cd41 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] End _get_guest_xml xml=<domain type="kvm">
Oct 24 00:08:57 user nova-compute[74482]:   <uuid>219dee94-e238-4f09-be21-f5c05ea2cd41</uuid>
Oct 24 00:08:57 user nova-compute[74482]:   <name>instance-00000033</name>
Oct 24 00:08:57 user nova-compute[74482]:   <memory>524288</memory>
Oct 24 00:08:57 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 24 00:08:57 user nova-compute[74482]:   <metadata>
Oct 24 00:08:57 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 24 00:08:57 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 24 00:08:57 user nova-compute[74482]:       <nova:name>tempest-TestVolumeBootPattern-server-471025606</nova:name>
Oct 24 00:08:57 user nova-compute[74482]:       <nova:creationTime>2023-10-24 00:08:56</nova:creationTime>
Oct 24 00:08:57 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 24 00:08:57 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 24 00:08:57 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 24 00:08:57 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 24 00:08:57 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 24 00:08:57 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 24 00:08:57 user nova-compute[74482]:       </nova:flavor>
Oct 24 00:08:57 user nova-compute[74482]:       <nova:owner>
Oct 24 00:08:57 user nova-compute[74482]:         <nova:user uuid="ab7adbba189645ecb67794b738c87db1">tempest-TestVolumeBootPattern-334654437-project-member</nova:user>
Oct 24 00:08:57 user nova-compute[74482]:         <nova:project uuid="bd1bcbe0d3b94e158cc20c6905b80f13">tempest-TestVolumeBootPattern-334654437</nova:project>
Oct 24 00:08:57 user nova-compute[74482]:       </nova:owner>
Oct 24 00:08:57 user nova-compute[74482]:       <nova:ports>
Oct 24 00:08:57 user nova-compute[74482]:         <nova:port uuid="da87dbc1-f3b0-4aca-8efc-ae479828001f">
Oct 24 00:08:57 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 24 00:08:57 user nova-compute[74482]:         </nova:port>
Oct 24 00:08:57 user nova-compute[74482]:       </nova:ports>
Oct 24 00:08:57 user nova-compute[74482]:     </nova:instance>
Oct 24 00:08:57 user nova-compute[74482]:   </metadata>
Oct 24 00:08:57 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 24 00:08:57 user nova-compute[74482]:     <system>
Oct 24 00:08:57 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 24 00:08:57 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 24 00:08:57 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 24 00:08:57 user nova-compute[74482]:       <entry name="serial">219dee94-e238-4f09-be21-f5c05ea2cd41</entry>
Oct 24 00:08:57 user nova-compute[74482]:       <entry name="uuid">219dee94-e238-4f09-be21-f5c05ea2cd41</entry>
Oct 24 00:08:57 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 24 00:08:57 user nova-compute[74482]:     </system>
Oct 24 00:08:57 user nova-compute[74482]:   </sysinfo>
Oct 24 00:08:57 user nova-compute[74482]:   <os>
Oct 24 00:08:57 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 24 00:08:57 user nova-compute[74482]:     <boot dev="hd"/>
Oct 24 00:08:57 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 24 00:08:57 user nova-compute[74482]:   </os>
Oct 24 00:08:57 user nova-compute[74482]:   <features>
Oct 24 00:08:57 user nova-compute[74482]:     <acpi/>
Oct 24 00:08:57 user nova-compute[74482]:     <apic/>
Oct 24 00:08:57 user nova-compute[74482]:     <vmcoreinfo/>
Oct 24 00:08:57 user nova-compute[74482]:   </features>
Oct 24 00:08:57 user nova-compute[74482]:   <clock offset="utc">
Oct 24 00:08:57 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 24 00:08:57 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 24 00:08:57 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 24 00:08:57 user nova-compute[74482]:   </clock>
Oct 24 00:08:57 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 24 00:08:57 user nova-compute[74482]:     <model>Nehalem</model>
Oct 24 00:08:57 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 24 00:08:57 user nova-compute[74482]:   </cpu>
Oct 24 00:08:57 user nova-compute[74482]:   <devices>
Oct 24 00:08:57 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 24 00:08:57 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:08:57 user nova-compute[74482]:       <source dev="/dev/sdb"/>
Oct 24 00:08:57 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 24 00:08:57 user nova-compute[74482]:       <serial>e3c55a44-0c00-4146-a742-3fd1c0bddc87</serial>
Oct 24 00:08:57 user nova-compute[74482]:     </disk>
Oct 24 00:08:57 user nova-compute[74482]:     <interface type="ethernet">
Oct 24 00:08:57 user nova-compute[74482]:       <mac address="fa:16:3e:a2:93:a0"/>
Oct 24 00:08:57 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:08:57 user nova-compute[74482]:       <mtu size="1442"/>
Oct 24 00:08:57 user nova-compute[74482]:       <target dev="tapda87dbc1-f3"/>
Oct 24 00:08:57 user nova-compute[74482]:     </interface>
Oct 24 00:08:57 user nova-compute[74482]:     <serial type="pty">
Oct 24 00:08:57 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/219dee94-e238-4f09-be21-f5c05ea2cd41/console.log" append="off"/>
Oct 24 00:08:57 user nova-compute[74482]:     </serial>
Oct 24 00:08:57 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 24 00:08:57 user nova-compute[74482]:     <video>
Oct 24 00:08:57 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:08:57 user nova-compute[74482]:     </video>
Oct 24 00:08:57 user nova-compute[74482]:     <rng model="virtio">
Oct 24 00:08:57 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 24 00:08:57 user nova-compute[74482]:     </rng>
Oct 24 00:08:57 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 24 00:08:57 user nova-compute[74482]:     <memballoon model="virtio">
Oct 24 00:08:57 user nova-compute[74482]:       <stats period="10"/>
Oct 24 00:08:57 user nova-compute[74482]:     </memballoon>
Oct 24 00:08:57 user nova-compute[74482]:   </devices>
Oct 24 00:08:57 user nova-compute[74482]: </domain>
Oct 24 00:08:57 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-471025606',display_name='tempest-TestVolumeBootPattern-server-471025606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-471025606',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFenSApZzr38aeVgwUFTcOFD9ye7qHMwMxmPxmttUPlVvePAAp4GN9mIygYjyr+hZYwre2qJ8M/Npq7c+l3v5A1qjZC5UiEOm16SDEq0ZjONZr1P2+8/aH2nSeJsef2Zg==',key_name='tempest-TestVolumeBootPattern-160083005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-06pzr0nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:08:41Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=219dee94-e238-4f09-be21-f5c05ea2cd41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:93:a0,bridge_name='br-int',has_traffic_filtering=True,id=da87dbc1-f3b0-4aca-8efc-ae479828001f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda87dbc1-f3') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG os_vif [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:93:a0,bridge_name='br-int',has_traffic_filtering=True,id=da87dbc1-f3b0-4aca-8efc-ae479828001f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda87dbc1-f3') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd60112f7-a869-5296-b382-6041f8582a47', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda87dbc1-f3, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda87dbc1-f3, col_values=(('qos', UUID('96c41c36-5509-4dc3-8704-afdb9d24decf')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:08:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda87dbc1-f3, col_values=(('external_ids', {'iface-id': 'da87dbc1-f3b0-4aca-8efc-ae479828001f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:93:a0', 'vm-uuid': '219dee94-e238-4f09-be21-f5c05ea2cd41'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:08:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:08:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:58 user nova-compute[74482]: INFO os_vif [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:93:a0,bridge_name='br-int',has_traffic_filtering=True,id=da87dbc1-f3b0-4aca-8efc-ae479828001f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda87dbc1-f3')
Oct 24 00:08:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:08:58 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No VIF found with MAC fa:16:3e:a2:93:a0, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-95dca11d-317d-4869-8d79-b5ccd6a0f025 req-b11a52b9-aec5-41ac-b54b-c784b09686b7 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received event network-vif-plugged-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95dca11d-317d-4869-8d79-b5ccd6a0f025 req-b11a52b9-aec5-41ac-b54b-c784b09686b7 service nova] Acquiring lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95dca11d-317d-4869-8d79-b5ccd6a0f025 req-b11a52b9-aec5-41ac-b54b-c784b09686b7 service nova] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95dca11d-317d-4869-8d79-b5ccd6a0f025 req-b11a52b9-aec5-41ac-b54b-c784b09686b7 service nova] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG nova.compute.manager [req-95dca11d-317d-4869-8d79-b5ccd6a0f025 req-b11a52b9-aec5-41ac-b54b-c784b09686b7 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] No waiting events found dispatching network-vif-plugged-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:08:59 user nova-compute[74482]: WARNING nova.compute.manager [req-95dca11d-317d-4869-8d79-b5ccd6a0f025 req-b11a52b9-aec5-41ac-b54b-c784b09686b7 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received unexpected event network-vif-plugged-da87dbc1-f3b0-4aca-8efc-ae479828001f for instance with vm_state building and task_state spawning.
Oct 24 00:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:08:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 24 00:09:01 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Instance spawned successfully.
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:09:01 user nova-compute[74482]: INFO nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Took 4.96 seconds to spawn the instance on the hypervisor.
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 24 00:09:01 user nova-compute[74482]: INFO nova.compute.manager [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Took 21.39 seconds to build instance.
Oct 24 00:09:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7bbd6634-5af2-4ecb-bd60-50797c0e9663 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.485s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-7529d684-69bf-48de-ba15-cfc0645e226b req-1667055b-8d46-400c-826c-be70b3115c9c service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received event network-vif-plugged-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7529d684-69bf-48de-ba15-cfc0645e226b req-1667055b-8d46-400c-826c-be70b3115c9c service nova] Acquiring lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7529d684-69bf-48de-ba15-cfc0645e226b req-1667055b-8d46-400c-826c-be70b3115c9c service nova] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-7529d684-69bf-48de-ba15-cfc0645e226b req-1667055b-8d46-400c-826c-be70b3115c9c service nova] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:09:01 user nova-compute[74482]: DEBUG nova.compute.manager [req-7529d684-69bf-48de-ba15-cfc0645e226b req-1667055b-8d46-400c-826c-be70b3115c9c service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] No waiting events found dispatching network-vif-plugged-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:09:01 user nova-compute[74482]: WARNING nova.compute.manager [req-7529d684-69bf-48de-ba15-cfc0645e226b req-1667055b-8d46-400c-826c-be70b3115c9c service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received unexpected event network-vif-plugged-da87dbc1-f3b0-4aca-8efc-ae479828001f for instance with vm_state active and task_state None.
Oct 24 00:09:02 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:09:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:09:02 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:09:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:09:02 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:09:02 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:09:02 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 219dee94-e238-4f09-be21-f5c05ea2cd41 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:09:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:03 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:09:03 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:09:03 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:09:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:09:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:09:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:09:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:09:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:09:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:09:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:09:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:09:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:09:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:09:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:09:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:09:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:09:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:09:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:09:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:09:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:09:23 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:09:23 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:09:24 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:09:24 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:09:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8863MB free_disk=24.910430908203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:09:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:09:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:09:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 219dee94-e238-4f09-be21-f5c05ea2cd41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:09:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:09:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:09:24 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:09:24 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:09:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:09:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:09:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:09:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:09:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:09:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:09:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:09:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:09:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:09:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:09:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:09:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:09:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:09:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:09:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:09:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:09:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:09:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 219dee94-e238-4f09-be21-f5c05ea2cd41 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:10:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:10:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:10:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:10:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:08 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:13 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:10:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:10:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:10:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:10:24 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:10:24 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:10:24 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:10:25 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:10:25 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:10:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=24.91360092163086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:10:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:10:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:10:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 219dee94-e238-4f09-be21-f5c05ea2cd41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:10:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:10:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:10:25 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:10:25 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:10:25 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:10:25 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:28 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:10:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-85cffad1-01be-4bd1-b0ed-e86fc95a6096 req-aaeb65b4-1e2f-4882-86e9-cdd27ec0dfa4 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received event network-changed-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:10:32 user nova-compute[74482]: DEBUG nova.compute.manager [req-85cffad1-01be-4bd1-b0ed-e86fc95a6096 req-aaeb65b4-1e2f-4882-86e9-cdd27ec0dfa4 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Refreshing instance network info cache due to event network-changed-da87dbc1-f3b0-4aca-8efc-ae479828001f. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:10:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-85cffad1-01be-4bd1-b0ed-e86fc95a6096 req-aaeb65b4-1e2f-4882-86e9-cdd27ec0dfa4 service nova] Acquiring lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:10:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-85cffad1-01be-4bd1-b0ed-e86fc95a6096 req-aaeb65b4-1e2f-4882-86e9-cdd27ec0dfa4 service nova] Acquired lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:10:32 user nova-compute[74482]: DEBUG nova.network.neutron [req-85cffad1-01be-4bd1-b0ed-e86fc95a6096 req-aaeb65b4-1e2f-4882-86e9-cdd27ec0dfa4 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Refreshing network info cache for port da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:10:32 user nova-compute[74482]: DEBUG nova.network.neutron [req-85cffad1-01be-4bd1-b0ed-e86fc95a6096 req-aaeb65b4-1e2f-4882-86e9-cdd27ec0dfa4 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updated VIF entry in instance network info cache for port da87dbc1-f3b0-4aca-8efc-ae479828001f. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:10:32 user nova-compute[74482]: DEBUG nova.network.neutron [req-85cffad1-01be-4bd1-b0ed-e86fc95a6096 req-aaeb65b4-1e2f-4882-86e9-cdd27ec0dfa4 service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:10:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-85cffad1-01be-4bd1-b0ed-e86fc95a6096 req-aaeb65b4-1e2f-4882-86e9-cdd27ec0dfa4 service nova] Releasing lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:10:33 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:38 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:43 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 24 00:10:48 user nova-compute[74482]: INFO nova.compute.claims [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Claim successful on node user
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 24 00:10:48 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.policy [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7adbba189645ecb67794b738c87db1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd1bcbe0d3b94e158cc20c6905b80f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 24 00:10:48 user nova-compute[74482]: INFO nova.virt.block_device [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Booting with volume 830dddbb-0bdb-46fa-909f-1310f459d547 at /dev/vda
Oct 24 00:10:48 user nova-compute[74482]: DEBUG os_brick.utils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d169f731-98e4-487c-b5b0-6c09c9f9c9bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f1e7d-e07e-47c1-8821-bb022cbb767c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[74056c41-747f-4905-ba42-ab7293984f50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db9d06d-f9a7-479a-a701-1c63bdf042ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:10:48 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 24 00:10:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df21a95-6fbd-40bb-a2ff-86f1aea306b5]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG os_brick.utils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:10:48 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Updating existing volume attachment record: 20c622ae-7689-4b89-b5f7-db1dc8eb7005 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 24 00:10:49 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Successfully created port: b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 24 00:10:49 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Successfully updated port: b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 24 00:10:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:10:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquired lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:10:49 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 24 00:10:49 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-04b8150d-0ee0-4bf9-9afa-e3d73a3cdde4 req-bdd37898-5584-4862-8d30-61164e00430a service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received event network-changed-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG nova.compute.manager [req-04b8150d-0ee0-4bf9-9afa-e3d73a3cdde4 req-bdd37898-5584-4862-8d30-61164e00430a service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Refreshing instance network info cache due to event network-changed-b0cf1cba-d040-4db8-8e24-913b59eafc48. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-04b8150d-0ee0-4bf9-9afa-e3d73a3cdde4 req-bdd37898-5584-4862-8d30-61164e00430a service nova] Acquiring lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG nova.network.neutron [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Updating instance_info_cache with network_info: [{"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Releasing lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Instance network_info: |[{"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-04b8150d-0ee0-4bf9-9afa-e3d73a3cdde4 req-bdd37898-5584-4862-8d30-61164e00430a service nova] Acquired lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG nova.network.neutron [req-04b8150d-0ee0-4bf9-9afa-e3d73a3cdde4 req-bdd37898-5584-4862-8d30-61164e00430a service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Refreshing network info cache for port b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG nova.network.neutron [req-04b8150d-0ee0-4bf9-9afa-e3d73a3cdde4 req-bdd37898-5584-4862-8d30-61164e00430a service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Updated VIF entry in instance network info cache for port b0cf1cba-d040-4db8-8e24-913b59eafc48. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG nova.network.neutron [req-04b8150d-0ee0-4bf9-9afa-e3d73a3cdde4 req-bdd37898-5584-4862-8d30-61164e00430a service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Updating instance_info_cache with network_info: [{"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:10:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-04b8150d-0ee0-4bf9-9afa-e3d73a3cdde4 req-bdd37898-5584-4862-8d30-61164e00430a service nova] Releasing lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:10:53 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:10:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:10:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:10:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:10:58 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Skipping network cache update for instance because it is Building. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 219dee94-e238-4f09-be21-f5c05ea2cd41 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 24 00:11:04 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Creating image(s)
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Did not create local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Ensure instance console log exists: /opt/stack/data/nova/instances/c3fffb18-3c96-4972-bf19-f64374fa5cdd/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Start _get_guest_xml network_info=[{"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMAbRZdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3fffb18-3c96-4972-bf19-f64374fa5cdd', 'attached_at': '', 'detached_at': '', 'volume_id': '830dddbb-0bdb-46fa-909f-1310f459d547', 'serial': '830dddbb-0bdb-46fa-909f-1310f459d547'}, 'disk_bus': 'virtio', 'attachment_id': '20c622ae-7689-4b89-b5f7-db1dc8eb7005', 'boot_index': 0, 'volume_type': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 24 00:11:04 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:11:04 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMAbRZdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:11:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:11:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:11:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:11:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:11:04 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[62908cf5-b33e-4d97-a55b-0f1f13424975]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 24 00:11:04 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:11:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0680c-4cc3-492e-86f8-4a8db20e4a48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547] added
Oct 24 00:11:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73ec1b4-dd8d-4d49-940d-af42d734cd5d]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b568f4b-605d-4215-9d6a-ebdce29f2232]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMAbRZdk {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VMAbRZdk" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a80510b-53aa-417b-8fe6-42622ceccb7a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VMAbRZdk'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b05353-51c7-4019-9017-f78ec071e328]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec8055e-f1ef-4726-bed8-12bcf38a6a08]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:11:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:11:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfde9786-111b-4582-8f7a-ff1cb1b791ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547, portal: 172.16.0.220,3260]
Oct 24 00:11:05 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547, portal: 172.16.0.220,3260] successful.
Oct 24 00:11:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedb3742-2a10-4f2f-a4dd-3b4696350600]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[925510a1-377d-4d7a-9113-9abbf330e2a3]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:11:05 user nova-compute[74482]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 (non-flash)
Oct 24 00:11:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:11:05 user nova-compute[74482]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 (non-flash)
Oct 24 00:11:05 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ceefa3-44f6-4278-b650-0ab30217e5da]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:11:05 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMAbRZdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23232333763376430', 'path': '/dev/sdc'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232333763376430', 'path': '/dev/sdc'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1383732789',display_name='tempest-TestVolumeBootPattern-server-1383732789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1383732789',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFenSApZzr38aeVgwUFTcOFD9ye7qHMwMxmPxmttUPlVvePAAp4GN9mIygYjyr+hZYwre2qJ8M/Npq7c+l3v5A1qjZC5UiEOm16SDEq0ZjONZr1P2+8/aH2nSeJsef2Zg==',key_name='tempest-TestVolumeBootPattern-160083005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-2tj2z6m1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:10:49Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=c3fffb18-3c96-4972-bf19-f64374fa5cdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:91:ed,bridge_name='br-int',has_traffic_filtering=True,id=b0cf1cba-d040-4db8-8e24-913b59eafc48,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf1cba-d0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'pci_devices' on Instance uuid c3fffb18-3c96-4972-bf19-f64374fa5cdd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] End _get_guest_xml xml=<domain type="kvm">
Oct 24 00:11:06 user nova-compute[74482]:   <uuid>c3fffb18-3c96-4972-bf19-f64374fa5cdd</uuid>
Oct 24 00:11:06 user nova-compute[74482]:   <name>instance-00000034</name>
Oct 24 00:11:06 user nova-compute[74482]:   <memory>524288</memory>
Oct 24 00:11:06 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 24 00:11:06 user nova-compute[74482]:   <metadata>
Oct 24 00:11:06 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 24 00:11:06 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 24 00:11:06 user nova-compute[74482]:       <nova:name>tempest-TestVolumeBootPattern-server-1383732789</nova:name>
Oct 24 00:11:06 user nova-compute[74482]:       <nova:creationTime>2023-10-24 00:11:04</nova:creationTime>
Oct 24 00:11:06 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 24 00:11:06 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 24 00:11:06 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 24 00:11:06 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 24 00:11:06 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 24 00:11:06 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 24 00:11:06 user nova-compute[74482]:       </nova:flavor>
Oct 24 00:11:06 user nova-compute[74482]:       <nova:owner>
Oct 24 00:11:06 user nova-compute[74482]:         <nova:user uuid="ab7adbba189645ecb67794b738c87db1">tempest-TestVolumeBootPattern-334654437-project-member</nova:user>
Oct 24 00:11:06 user nova-compute[74482]:         <nova:project uuid="bd1bcbe0d3b94e158cc20c6905b80f13">tempest-TestVolumeBootPattern-334654437</nova:project>
Oct 24 00:11:06 user nova-compute[74482]:       </nova:owner>
Oct 24 00:11:06 user nova-compute[74482]:       <nova:ports>
Oct 24 00:11:06 user nova-compute[74482]:         <nova:port uuid="b0cf1cba-d040-4db8-8e24-913b59eafc48">
Oct 24 00:11:06 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 24 00:11:06 user nova-compute[74482]:         </nova:port>
Oct 24 00:11:06 user nova-compute[74482]:       </nova:ports>
Oct 24 00:11:06 user nova-compute[74482]:     </nova:instance>
Oct 24 00:11:06 user nova-compute[74482]:   </metadata>
Oct 24 00:11:06 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 24 00:11:06 user nova-compute[74482]:     <system>
Oct 24 00:11:06 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 24 00:11:06 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 24 00:11:06 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 24 00:11:06 user nova-compute[74482]:       <entry name="serial">c3fffb18-3c96-4972-bf19-f64374fa5cdd</entry>
Oct 24 00:11:06 user nova-compute[74482]:       <entry name="uuid">c3fffb18-3c96-4972-bf19-f64374fa5cdd</entry>
Oct 24 00:11:06 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 24 00:11:06 user nova-compute[74482]:     </system>
Oct 24 00:11:06 user nova-compute[74482]:   </sysinfo>
Oct 24 00:11:06 user nova-compute[74482]:   <os>
Oct 24 00:11:06 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 24 00:11:06 user nova-compute[74482]:     <boot dev="hd"/>
Oct 24 00:11:06 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 24 00:11:06 user nova-compute[74482]:   </os>
Oct 24 00:11:06 user nova-compute[74482]:   <features>
Oct 24 00:11:06 user nova-compute[74482]:     <acpi/>
Oct 24 00:11:06 user nova-compute[74482]:     <apic/>
Oct 24 00:11:06 user nova-compute[74482]:     <vmcoreinfo/>
Oct 24 00:11:06 user nova-compute[74482]:   </features>
Oct 24 00:11:06 user nova-compute[74482]:   <clock offset="utc">
Oct 24 00:11:06 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 24 00:11:06 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 24 00:11:06 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 24 00:11:06 user nova-compute[74482]:   </clock>
Oct 24 00:11:06 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 24 00:11:06 user nova-compute[74482]:     <model>Nehalem</model>
Oct 24 00:11:06 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 24 00:11:06 user nova-compute[74482]:   </cpu>
Oct 24 00:11:06 user nova-compute[74482]:   <devices>
Oct 24 00:11:06 user nova-compute[74482]:     <disk type="block" device="disk">
Oct 24 00:11:06 user nova-compute[74482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:11:06 user nova-compute[74482]:       <source dev="/dev/sdc"/>
Oct 24 00:11:06 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 24 00:11:06 user nova-compute[74482]:       <serial>830dddbb-0bdb-46fa-909f-1310f459d547</serial>
Oct 24 00:11:06 user nova-compute[74482]:     </disk>
Oct 24 00:11:06 user nova-compute[74482]:     <interface type="ethernet">
Oct 24 00:11:06 user nova-compute[74482]:       <mac address="fa:16:3e:13:91:ed"/>
Oct 24 00:11:06 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:11:06 user nova-compute[74482]:       <mtu size="1442"/>
Oct 24 00:11:06 user nova-compute[74482]:       <target dev="tapb0cf1cba-d0"/>
Oct 24 00:11:06 user nova-compute[74482]:     </interface>
Oct 24 00:11:06 user nova-compute[74482]:     <serial type="pty">
Oct 24 00:11:06 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/c3fffb18-3c96-4972-bf19-f64374fa5cdd/console.log" append="off"/>
Oct 24 00:11:06 user nova-compute[74482]:     </serial>
Oct 24 00:11:06 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 24 00:11:06 user nova-compute[74482]:     <video>
Oct 24 00:11:06 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:11:06 user nova-compute[74482]:     </video>
Oct 24 00:11:06 user nova-compute[74482]:     <rng model="virtio">
Oct 24 00:11:06 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 24 00:11:06 user nova-compute[74482]:     </rng>
Oct 24 00:11:06 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 24 00:11:06 user nova-compute[74482]:     <memballoon model="virtio">
Oct 24 00:11:06 user nova-compute[74482]:       <stats period="10"/>
Oct 24 00:11:06 user nova-compute[74482]:     </memballoon>
Oct 24 00:11:06 user nova-compute[74482]:   </devices>
Oct 24 00:11:06 user nova-compute[74482]: </domain>
Oct 24 00:11:06 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1383732789',display_name='tempest-TestVolumeBootPattern-server-1383732789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1383732789',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFenSApZzr38aeVgwUFTcOFD9ye7qHMwMxmPxmttUPlVvePAAp4GN9mIygYjyr+hZYwre2qJ8M/Npq7c+l3v5A1qjZC5UiEOm16SDEq0ZjONZr1P2+8/aH2nSeJsef2Zg==',key_name='tempest-TestVolumeBootPattern-160083005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-2tj2z6m1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:10:49Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=c3fffb18-3c96-4972-bf19-f64374fa5cdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:91:ed,bridge_name='br-int',has_traffic_filtering=True,id=b0cf1cba-d040-4db8-8e24-913b59eafc48,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf1cba-d0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG os_vif [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:91:ed,bridge_name='br-int',has_traffic_filtering=True,id=b0cf1cba-d040-4db8-8e24-913b59eafc48,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf1cba-d0') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9718a2d8-db6c-5062-8f0e-b99356fbbb46', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0cf1cba-d0, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0cf1cba-d0, col_values=(('qos', UUID('8fd024f5-bb01-482e-854c-25bb06718f96')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0cf1cba-d0, col_values=(('external_ids', {'iface-id': 'b0cf1cba-d040-4db8-8e24-913b59eafc48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:91:ed', 'vm-uuid': 'c3fffb18-3c96-4972-bf19-f64374fa5cdd'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:06 user nova-compute[74482]: INFO os_vif [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:91:ed,bridge_name='br-int',has_traffic_filtering=True,id=b0cf1cba-d040-4db8-8e24-913b59eafc48,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf1cba-d0')
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] No VIF found with MAC fa:16:3e:13:91:ed, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:11:06 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-2b441e0f-1c1b-401d-979f-4304b93669e5 req-b05f4037-32da-4dbd-80f9-c9b7808d2489 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received event network-vif-plugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:11:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2b441e0f-1c1b-401d-979f-4304b93669e5 req-b05f4037-32da-4dbd-80f9-c9b7808d2489 service nova] Acquiring lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:11:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2b441e0f-1c1b-401d-979f-4304b93669e5 req-b05f4037-32da-4dbd-80f9-c9b7808d2489 service nova] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:11:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-2b441e0f-1c1b-401d-979f-4304b93669e5 req-b05f4037-32da-4dbd-80f9-c9b7808d2489 service nova] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:11:07 user nova-compute[74482]: DEBUG nova.compute.manager [req-2b441e0f-1c1b-401d-979f-4304b93669e5 req-b05f4037-32da-4dbd-80f9-c9b7808d2489 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] No waiting events found dispatching network-vif-plugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:11:07 user nova-compute[74482]: WARNING nova.compute.manager [req-2b441e0f-1c1b-401d-979f-4304b93669e5 req-b05f4037-32da-4dbd-80f9-c9b7808d2489 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received unexpected event network-vif-plugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 for instance with vm_state building and task_state spawning.
Oct 24 00:11:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:08 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:08 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 24 00:11:09 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Instance spawned successfully.
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-5aebac54-7f58-49f7-8251-5bc5b4dfe2fa req-3758cf20-4e57-486e-830a-677aaf375909 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received event network-vif-plugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5aebac54-7f58-49f7-8251-5bc5b4dfe2fa req-3758cf20-4e57-486e-830a-677aaf375909 service nova] Acquiring lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5aebac54-7f58-49f7-8251-5bc5b4dfe2fa req-3758cf20-4e57-486e-830a-677aaf375909 service nova] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-5aebac54-7f58-49f7-8251-5bc5b4dfe2fa req-3758cf20-4e57-486e-830a-677aaf375909 service nova] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.compute.manager [req-5aebac54-7f58-49f7-8251-5bc5b4dfe2fa req-3758cf20-4e57-486e-830a-677aaf375909 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] No waiting events found dispatching network-vif-plugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:11:09 user nova-compute[74482]: WARNING nova.compute.manager [req-5aebac54-7f58-49f7-8251-5bc5b4dfe2fa req-3758cf20-4e57-486e-830a-677aaf375909 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received unexpected event network-vif-plugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 for instance with vm_state building and task_state spawning.
Oct 24 00:11:09 user nova-compute[74482]: INFO nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Took 5.06 seconds to spawn the instance on the hypervisor.
Oct 24 00:11:09 user nova-compute[74482]: DEBUG nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 24 00:11:10 user nova-compute[74482]: INFO nova.compute.manager [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Took 21.73 seconds to build instance.
Oct 24 00:11:10 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4259922d-4d80-4279-957b-ef456ed5feaf tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.849s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:11:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:11:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:11:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 24 00:11:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 24 00:11:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:11:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:11:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:11:26 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:11:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:11:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:11:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:11:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=24.911720275878906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 219dee94-e238-4f09-be21-f5c05ea2cd41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c3fffb18-3c96-4972-bf19-f64374fa5cdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:11:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:11:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:37 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 24 00:11:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:11:46 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:11:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:11:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:05 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:12:05 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:12:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:12:05 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:12:05 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:12:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 219dee94-e238-4f09-be21-f5c05ea2cd41 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:12:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:06 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:12:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:12:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:12:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:12:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:12:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:12:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:12:26 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:12:26 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:12:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:12:26 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:12:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:12:27 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=24.91109848022461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 219dee94-e238-4f09-be21-f5c05ea2cd41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance c3fffb18-3c96-4972-bf19-f64374fa5cdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:12:27 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:12:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:12:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:12:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-52cceae0-039d-4441-a5ff-3a0bfa732040 req-1eb8aa00-f8a1-48f4-8fd9-1ad212fc9ab3 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received event network-changed-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:12:39 user nova-compute[74482]: DEBUG nova.compute.manager [req-52cceae0-039d-4441-a5ff-3a0bfa732040 req-1eb8aa00-f8a1-48f4-8fd9-1ad212fc9ab3 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Refreshing instance network info cache due to event network-changed-b0cf1cba-d040-4db8-8e24-913b59eafc48. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:12:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-52cceae0-039d-4441-a5ff-3a0bfa732040 req-1eb8aa00-f8a1-48f4-8fd9-1ad212fc9ab3 service nova] Acquiring lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:12:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-52cceae0-039d-4441-a5ff-3a0bfa732040 req-1eb8aa00-f8a1-48f4-8fd9-1ad212fc9ab3 service nova] Acquired lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:12:39 user nova-compute[74482]: DEBUG nova.network.neutron [req-52cceae0-039d-4441-a5ff-3a0bfa732040 req-1eb8aa00-f8a1-48f4-8fd9-1ad212fc9ab3 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Refreshing network info cache for port b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG nova.network.neutron [req-52cceae0-039d-4441-a5ff-3a0bfa732040 req-1eb8aa00-f8a1-48f4-8fd9-1ad212fc9ab3 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Updated VIF entry in instance network info cache for port b0cf1cba-d040-4db8-8e24-913b59eafc48. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG nova.network.neutron [req-52cceae0-039d-4441-a5ff-3a0bfa732040 req-1eb8aa00-f8a1-48f4-8fd9-1ad212fc9ab3 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Updating instance_info_cache with network_info: [{"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-52cceae0-039d-4441-a5ff-3a0bfa732040 req-1eb8aa00-f8a1-48f4-8fd9-1ad212fc9ab3 service nova] Releasing lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-a870559a-b3d6-4cca-a310-cf4146e74ec7 req-d951e35f-ddde-4ac0-b4a6-11dc9171e73d service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received event network-changed-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG nova.compute.manager [req-a870559a-b3d6-4cca-a310-cf4146e74ec7 req-d951e35f-ddde-4ac0-b4a6-11dc9171e73d service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Refreshing instance network info cache due to event network-changed-b0cf1cba-d040-4db8-8e24-913b59eafc48. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a870559a-b3d6-4cca-a310-cf4146e74ec7 req-d951e35f-ddde-4ac0-b4a6-11dc9171e73d service nova] Acquiring lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a870559a-b3d6-4cca-a310-cf4146e74ec7 req-d951e35f-ddde-4ac0-b4a6-11dc9171e73d service nova] Acquired lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG nova.network.neutron [req-a870559a-b3d6-4cca-a310-cf4146e74ec7 req-d951e35f-ddde-4ac0-b4a6-11dc9171e73d service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Refreshing network info cache for port b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:12:40 user nova-compute[74482]: INFO nova.compute.manager [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Terminating instance
Oct 24 00:12:40 user nova-compute[74482]: DEBUG nova.compute.manager [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 24 00:12:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-a870559a-b3d6-4cca-a310-cf4146e74ec7 req-d951e35f-ddde-4ac0-b4a6-11dc9171e73d service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Updated VIF entry in instance network info cache for port b0cf1cba-d040-4db8-8e24-913b59eafc48. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG nova.network.neutron [req-a870559a-b3d6-4cca-a310-cf4146e74ec7 req-d951e35f-ddde-4ac0-b4a6-11dc9171e73d service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Updating instance_info_cache with network_info: [{"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-a870559a-b3d6-4cca-a310-cf4146e74ec7 req-d951e35f-ddde-4ac0-b4a6-11dc9171e73d service nova] Releasing lock "refresh_cache-c3fffb18-3c96-4972-bf19-f64374fa5cdd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Instance destroyed successfully.
Oct 24 00:12:41 user nova-compute[74482]: DEBUG nova.objects.instance [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'resources' on Instance uuid c3fffb18-3c96-4972-bf19-f64374fa5cdd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1383732789',display_name='tempest-TestVolumeBootPattern-server-1383732789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1383732789',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFenSApZzr38aeVgwUFTcOFD9ye7qHMwMxmPxmttUPlVvePAAp4GN9mIygYjyr+hZYwre2qJ8M/Npq7c+l3v5A1qjZC5UiEOm16SDEq0ZjONZr1P2+8/aH2nSeJsef2Zg==',key_name='tempest-TestVolumeBootPattern-160083005',keypairs=<?>,launch_index=0,launched_at=2023-10-24T00:11:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-2tj2z6m1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-24T00:11:10Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=c3fffb18-3c96-4972-bf19-f64374fa5cdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "address": "fa:16:3e:13:91:ed", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0cf1cba-d0", "ovs_interfaceid": "b0cf1cba-d040-4db8-8e24-913b59eafc48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:91:ed,bridge_name='br-int',has_traffic_filtering=True,id=b0cf1cba-d040-4db8-8e24-913b59eafc48,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf1cba-d0') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_vif [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:91:ed,bridge_name='br-int',has_traffic_filtering=True,id=b0cf1cba-d040-4db8-8e24-913b59eafc48,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf1cba-d0') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0cf1cba-d0, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fd024f5-bb01-482e-854c-25bb06718f96) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:41 user nova-compute[74482]: INFO os_vif [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:91:ed,bridge_name='br-int',has_traffic_filtering=True,id=b0cf1cba-d040-4db8-8e24-913b59eafc48,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0cf1cba-d0')
Oct 24 00:12:41 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VMAbRZdk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:12:41 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a8669f-ea25-45ad-811a-63f0947d960d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 24 00:12:41 user nova-compute[74482]: No targets found.
Oct 24 00:12:41 user nova-compute[74482]: iSNS:
Oct 24 00:12:41 user nova-compute[74482]: No targets found.
Oct 24 00:12:41 user nova-compute[74482]: STATIC:
Oct 24 00:12:41 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87
Oct 24 00:12:41 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:12:41 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:12:41 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547
Oct 24 00:12:41 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:12:41 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:12:41 user nova-compute[74482]: FIRMWARE:
Oct 24 00:12:41 user nova-compute[74482]: No targets found.
Oct 24 00:12:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 24 00:12:41 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 24 00:12:41 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb47985d-2986-4960-b3ad-f9905758f185]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[39487b6c-f2b9-4c9c-a2e3-243814ce69fd]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:12:41 user nova-compute[74482]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 (non-flash)
Oct 24 00:12:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:12:41 user nova-compute[74482]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 (non-flash)
Oct 24 00:12:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3084266cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547'): ({'sdc'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Removing single pathed devices sdc {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1531a69-1d49-474e-a9c8-6029169b2175]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0612004-4285-46d8-af80-0e0c4907f138]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flushing IO for device /dev/sdc {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[003d4c18-c56d-490d-952d-a9c745b9896a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b13f49-876c-40ba-a4b8-c9a929a7c0c0]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] SCSI volumes sdc have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4343a75-2237c7d016f02149', '/dev/disk/by-id/scsi-23232333763376430', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4343a75') {{(pid=86306) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daf6b84-10c6-4278-b7f5-2742d0f3f2c1]: (4, None) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c74f3f0-de0e-44cd-827b-c8b2d586fdc8]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[674dcb5c-7ed6-4a22-ba7a-951b31398a13]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547, portal: 172.16.0.220,3260]
Oct 24 00:12:41 user nova-compute[74482]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547, portal: 172.16.0.220,3260] successful.
Oct 24 00:12:41 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:12:41 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:830dddbb-0bdb-46fa-909f-1310f459d547 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0783f517-2ec2-418e-855d-e3f1902f16bc]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== disconnect_volume: return (295ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 24 00:12:42 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Deleting instance files /opt/stack/data/nova/instances/c3fffb18-3c96-4972-bf19-f64374fa5cdd_del
Oct 24 00:12:42 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Deletion of /opt/stack/data/nova/instances/c3fffb18-3c96-4972-bf19-f64374fa5cdd_del complete
Oct 24 00:12:42 user nova-compute[74482]: INFO nova.compute.manager [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 24 00:12:42 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:12:42 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Took 0.35 seconds to deallocate network for instance.
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-54284227-a58e-4c62-9ad1-32a91c85dd09 req-75de083a-da69-4f1e-b3c8-177c8739fb9a service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received event network-vif-deleted-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received event network-vif-unplugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] Acquiring lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] No waiting events found dispatching network-vif-unplugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received event network-vif-unplugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received event network-vif-plugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] Acquiring lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:12:42 user nova-compute[74482]: DEBUG nova.compute.manager [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] No waiting events found dispatching network-vif-plugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:12:42 user nova-compute[74482]: WARNING nova.compute.manager [req-84ff401f-fdaa-40f0-8c3b-857ebade8b58 req-8da42259-e238-48d3-aeb1-f59ec86779e9 service nova] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Received unexpected event network-vif-plugged-b0cf1cba-d040-4db8-8e24-913b59eafc48 for instance with vm_state active and task_state deleting.
Oct 24 00:12:43 user nova-compute[74482]: INFO nova.compute.manager [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: c3fffb18-3c96-4972-bf19-f64374fa5cdd] Took 0.77 seconds to detach 1 volumes for instance.
Oct 24 00:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:12:43 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:12:43 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:12:43 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Deleted allocations for instance c3fffb18-3c96-4972-bf19-f64374fa5cdd
Oct 24 00:12:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-a014d07c-4cd8-4e25-b2b6-ca54977d0d92 tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "c3fffb18-3c96-4972-bf19-f64374fa5cdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.591s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:12:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:12:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:13:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:13:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:13:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:13:07 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:13:07 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:13:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:13:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:13:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:13:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:13:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:13:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:13:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:13:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:13:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:13:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:13:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:13:28 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:13:28 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:13:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:13:29 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:13:29 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:13:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=24.902435302734375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:13:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:13:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:13:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 219dee94-e238-4f09-be21-f5c05ea2cd41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:13:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:13:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:13:29 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:13:29 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:13:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:13:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:13:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:13:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:13:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:13:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:13:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:13:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-f202b913-7ae6-4060-be8e-d9421489f3c4 req-6f212f71-6193-4566-8a7c-4dddbee6095b service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received event network-changed-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG nova.compute.manager [req-f202b913-7ae6-4060-be8e-d9421489f3c4 req-6f212f71-6193-4566-8a7c-4dddbee6095b service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Refreshing instance network info cache due to event network-changed-da87dbc1-f3b0-4aca-8efc-ae479828001f. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f202b913-7ae6-4060-be8e-d9421489f3c4 req-6f212f71-6193-4566-8a7c-4dddbee6095b service nova] Acquiring lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f202b913-7ae6-4060-be8e-d9421489f3c4 req-6f212f71-6193-4566-8a7c-4dddbee6095b service nova] Acquired lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-f202b913-7ae6-4060-be8e-d9421489f3c4 req-6f212f71-6193-4566-8a7c-4dddbee6095b service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Refreshing network info cache for port da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "219dee94-e238-4f09-be21-f5c05ea2cd41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:13:51 user nova-compute[74482]: INFO nova.compute.manager [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Terminating instance
Oct 24 00:13:51 user nova-compute[74482]: DEBUG nova.compute.manager [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-f202b913-7ae6-4060-be8e-d9421489f3c4 req-6f212f71-6193-4566-8a7c-4dddbee6095b service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updated VIF entry in instance network info cache for port da87dbc1-f3b0-4aca-8efc-ae479828001f. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG nova.network.neutron [req-f202b913-7ae6-4060-be8e-d9421489f3c4 req-6f212f71-6193-4566-8a7c-4dddbee6095b service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [{"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:51 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-f202b913-7ae6-4060-be8e-d9421489f3c4 req-6f212f71-6193-4566-8a7c-4dddbee6095b service nova] Releasing lock "refresh_cache-219dee94-e238-4f09-be21-f5c05ea2cd41" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:13:51 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Instance destroyed successfully.
Oct 24 00:13:51 user nova-compute[74482]: DEBUG nova.objects.instance [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lazy-loading 'resources' on Instance uuid 219dee94-e238-4f09-be21-f5c05ea2cd41 {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:08:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-471025606',display_name='tempest-TestVolumeBootPattern-server-471025606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-471025606',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFenSApZzr38aeVgwUFTcOFD9ye7qHMwMxmPxmttUPlVvePAAp4GN9mIygYjyr+hZYwre2qJ8M/Npq7c+l3v5A1qjZC5UiEOm16SDEq0ZjONZr1P2+8/aH2nSeJsef2Zg==',key_name='tempest-TestVolumeBootPattern-160083005',keypairs=<?>,launch_index=0,launched_at=2023-10-24T00:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd1bcbe0d3b94e158cc20c6905b80f13',ramdisk_id='',reservation_id='r-06pzr0nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-334654437',owner_user_name='tempest-TestVolumeBootPattern-334654437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-24T00:09:02Z,user_data=None,user_id='ab7adbba189645ecb67794b738c87db1',uuid=219dee94-e238-4f09-be21-f5c05ea2cd41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converting VIF {"id": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "address": "fa:16:3e:a2:93:a0", "network": {"id": "11fb049a-6e64-4bd4-8c7c-9496533f6917", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-356122808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd1bcbe0d3b94e158cc20c6905b80f13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda87dbc1-f3", "ovs_interfaceid": "da87dbc1-f3b0-4aca-8efc-ae479828001f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:93:a0,bridge_name='br-int',has_traffic_filtering=True,id=da87dbc1-f3b0-4aca-8efc-ae479828001f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda87dbc1-f3') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_vif [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:93:a0,bridge_name='br-int',has_traffic_filtering=True,id=da87dbc1-f3b0-4aca-8efc-ae479828001f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda87dbc1-f3') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda87dbc1-f3, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96c41c36-5509-4dc3-8704-afdb9d24decf) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:13:52 user nova-compute[74482]: INFO os_vif [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:93:a0,bridge_name='br-int',has_traffic_filtering=True,id=da87dbc1-f3b0-4aca-8efc-ae479828001f,network=Network(11fb049a-6e64-4bd4-8c7c-9496533f6917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda87dbc1-f3')
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMBkfrdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:13:52 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[01400244-b16f-4497-8ab1-a7c1dbf0a1f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 24 00:13:52 user nova-compute[74482]: No targets found.
Oct 24 00:13:52 user nova-compute[74482]: iSNS:
Oct 24 00:13:52 user nova-compute[74482]: No targets found.
Oct 24 00:13:52 user nova-compute[74482]: STATIC:
Oct 24 00:13:52 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87
Oct 24 00:13:52 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:13:52 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:13:52 user nova-compute[74482]: FIRMWARE:
Oct 24 00:13:52 user nova-compute[74482]: No targets found.
Oct 24 00:13:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 24 00:13:52 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 24 00:13:52 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe66df1b-9c16-45a8-ad3c-126cfaf503f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[134c6edf-7386-44ad-8b91-728fcd8f5917]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:13:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 (non-flash)
Oct 24 00:13:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c44acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd8dd93-7790-44e7-be63-865bdd866434]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[59223f4a-891f-4597-b743-2c05b45b4a69]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ef4a90-b807-4c08-ab03-b5ddfb68c870]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7f4e89-1b3a-44b2-8a12-e148c32c3dcd]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe067fad6-6a881c6eda38f047', '/dev/disk/by-id/scsi-23661383831633665', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e067fad6') {{(pid=86306) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c88515-27d3-4b94-973b-baf8c583983b]: (4, None) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8823f48-265e-4903-aaf5-c77fbc254e21]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c654816a-8e67-4808-8310-1ec13d1b8b89]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260]
Oct 24 00:13:52 user nova-compute[74482]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87, portal: 172.16.0.220,3260] successful.
Oct 24 00:13:52 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3c55a44-0c00-4146-a742-3fd1c0bddc87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d0d785-4ca9-4455-912e-fd7faddc19df]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] <== disconnect_volume: return (276ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 24 00:13:52 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Deleting instance files /opt/stack/data/nova/instances/219dee94-e238-4f09-be21-f5c05ea2cd41_del
Oct 24 00:13:52 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Deletion of /opt/stack/data/nova/instances/219dee94-e238-4f09-be21-f5c05ea2cd41_del complete
Oct 24 00:13:52 user nova-compute[74482]: INFO nova.compute.manager [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 24 00:13:52 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-c24d0b50-493b-4032-aa95-1b8b7ae436a5 req-e918ce43-6657-44b5-ab6b-0a2fb6b06f9b service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received event network-vif-deleted-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:13:52 user nova-compute[74482]: INFO nova.compute.manager [req-c24d0b50-493b-4032-aa95-1b8b7ae436a5 req-e918ce43-6657-44b5-ab6b-0a2fb6b06f9b service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Neutron deleted interface da87dbc1-f3b0-4aca-8efc-ae479828001f; detaching it from the instance and deleting it from the info cache
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.network.neutron [req-c24d0b50-493b-4032-aa95-1b8b7ae436a5 req-e918ce43-6657-44b5-ab6b-0a2fb6b06f9b service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:13:52 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Took 0.43 seconds to deallocate network for instance.
Oct 24 00:13:52 user nova-compute[74482]: DEBUG nova.compute.manager [req-c24d0b50-493b-4032-aa95-1b8b7ae436a5 req-e918ce43-6657-44b5-ab6b-0a2fb6b06f9b service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Detach interface failed, port_id=da87dbc1-f3b0-4aca-8efc-ae479828001f, reason: Instance 219dee94-e238-4f09-be21-f5c05ea2cd41 could not be found. {{(pid=74482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received event network-vif-unplugged-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] Acquiring lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] No waiting events found dispatching network-vif-unplugged-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received event network-vif-unplugged-da87dbc1-f3b0-4aca-8efc-ae479828001f for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received event network-vif-plugged-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] Acquiring lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG nova.compute.manager [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] No waiting events found dispatching network-vif-plugged-da87dbc1-f3b0-4aca-8efc-ae479828001f {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:13:53 user nova-compute[74482]: WARNING nova.compute.manager [req-95f2f26b-52f0-492b-938b-2f1ef2b7f01c req-20157652-95ef-4da7-b2f6-9d48680d33ee service nova] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Received unexpected event network-vif-plugged-da87dbc1-f3b0-4aca-8efc-ae479828001f for instance with vm_state active and task_state deleting.
Oct 24 00:13:53 user nova-compute[74482]: INFO nova.compute.manager [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] [instance: 219dee94-e238-4f09-be21-f5c05ea2cd41] Took 0.85 seconds to detach 1 volumes for instance.
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:13:53 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Deleted allocations for instance 219dee94-e238-4f09-be21-f5c05ea2cd41
Oct 24 00:13:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-808fbf00-1e3a-4223-9817-ab9c3a609c0e tempest-TestVolumeBootPattern-334654437 tempest-TestVolumeBootPattern-334654437-project-member] Lock "219dee94-e238-4f09-be21-f5c05ea2cd41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.703s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:13:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:14:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:14:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:14:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:14:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:14:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:14:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:14:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:14:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:14:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:14:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:14:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:10 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:10 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:14:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:14:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:14:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:14:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:14:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:14:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:14:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:14:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:14:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:14:29 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:14:30 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:14:30 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:14:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9059MB free_disk=24.901504516601562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:14:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:14:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:14:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:14:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:14:30 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:14:30 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:14:30 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:14:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:14:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:14:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:37 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:14:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:14:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:14:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:15:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:15:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:15:09 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:15:11 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:15:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:15:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:15:11 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:15:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:15:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:15:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:15:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:15:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:15:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:15:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:15:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:15:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:15:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:15:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:15:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:15:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:15:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:15:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:15:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:15:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:15:32 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:15:32 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:15:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9061MB free_disk=24.89980697631836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:15:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:15:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:15:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:15:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:15:32 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:15:32 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:15:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:15:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:15:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:15:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:15:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:15:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:15:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:15:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:15:42 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:15:47 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:15:52 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:15:57 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:02 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:07 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:11 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:12 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:16:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:16:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:16:12 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:12 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:16:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:17 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_power_states {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:22 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:23 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:27 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.004s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Verify base images {{(pid=74482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae
Oct 24 00:16:29 user nova-compute[74482]: WARNING nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Unknown base file: /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Removable base files: /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209 /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74 /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06 /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5 /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050 /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1f01ffe1ccaa317feda4e88ac3ba9718cad23209
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2c974ea9e38eb1c4c2f1680ca25a0429ab65228f
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/296794b320af4cfe4f2169c6143fa6260aceff74
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f07d43b3936431260ee5bc51347aa653a1bbf06
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ddf1c67a5f2906efdb4e4f07700acd9862f644e5
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e2d6a32f0eb9fbabf0a51a25f9e82e2bb47406fa
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d27f84ee5f50c41dcc1fa959a40442e76f608050
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/578354ccd0a2c95fd922e5bf4b3c8f52e2e8e9fd
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae
Oct 24 00:16:29 user nova-compute[74482]: INFO nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f5b23a38bcf5d7a6375a0957139d966fe58252ba
Oct 24 00:16:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Verification complete {{(pid=74482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Verify swap images {{(pid=74482) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 24 00:16:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.imagecache [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Verify ephemeral images {{(pid=74482) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 24 00:16:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Starting instance... {{(pid=74482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 24 00:16:31 user nova-compute[74482]: INFO nova.compute.claims [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Claim successful on node user
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Start building networks asynchronously for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.085s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Allocating IP information in the background. {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 24 00:16:31 user nova-compute[74482]: DEBUG nova.network.neutron [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] allocate_for_instance() {{(pid=74482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 24 00:16:32 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:16:32 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=24.87899398803711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Start building block device mappings for instance. {{(pid=74482) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.policy [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8586e036aeec4849b3e7e232dae7010b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef65af6d89d4a52861e693e717bf051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74482) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4284cf45-9291-4fa4-9264-3aa4f8debafd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Start spawning the instance on the hypervisor. {{(pid=74482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Creating instance directory {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 24 00:16:32 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Creating image(s)
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "/opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "/opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "/opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.189s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.182s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk 1073741824 {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae,backing_fmt=raw /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk 1073741824" returned: 0 in 0.135s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7bb1e6d47baa9e9dd8359f4e8312ab7f869bdae --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk. size=1073741824 {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG nova.network.neutron [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Successfully created port: ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG nova.virt.disk.api [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Cannot resize image /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk to a smaller size. {{(pid=74482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Created local disks {{(pid=74482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Ensure instance console log exists: /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/console.log {{(pid=74482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Successfully updated port: ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Building network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Instance cache missing network info. {{(pid=74482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-c5db307f-3cd3-47f6-bffa-b4b46acf28bc req-f0db41ee-3a30-4de9-a7b1-5bae1f8bea38 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received event network-changed-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.compute.manager [req-c5db307f-3cd3-47f6-bffa-b4b46acf28bc req-f0db41ee-3a30-4de9-a7b1-5bae1f8bea38 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Refreshing instance network info cache due to event network-changed-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c5db307f-3cd3-47f6-bffa-b4b46acf28bc req-f0db41ee-3a30-4de9-a7b1-5bae1f8bea38 service nova] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.neutron [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Instance network_info: |[{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c5db307f-3cd3-47f6-bffa-b4b46acf28bc req-f0db41ee-3a30-4de9-a7b1-5bae1f8bea38 service nova] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.neutron [req-c5db307f-3cd3-47f6-bffa-b4b46acf28bc req-f0db41ee-3a30-4de9-a7b1-5bae1f8bea38 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Refreshing network info cache for port ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Start _get_guest_xml network_info=[{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'encrypted': False, 'image_id': '8269c4ae-64d4-478e-8976-b601953bda88'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 24 00:16:34 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:16:34 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] CPU controller missing on host. {{(pid=74482) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.host [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] CPU controller found on host. {{(pid=74482) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T22:55:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T22:55:26Z,direct_url=<?>,disk_format='qcow2',id=8269c4ae-64d4-478e-8976-b601953bda88,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7e55d11d12fb44cd95955f09699cc673',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T22:55:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Flavor limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Image limits 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Flavor pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Image pref 0:0:0 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Got 1 possible topologies {{(pid=74482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.hardware [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:16:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1487705987',display_name='tempest-SnapshotDataIntegrityTests-server-1487705987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1487705987',id=53,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt+9VDTuXBY0ZR4sfMNf5Rrlo6rOZ/QgEB/hH1bWLdNs9ulZU4wraEl/cgkVoGR1V4y0Edev8oPWUfOk/cNvGE/YsDSq4c+wh0153cbhF398hdsRfkVdFAKkeBifdg9XQ==',key_name='tempest-keypair-650341276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef65af6d89d4a52861e693e717bf051',ramdisk_id='',reservation_id='r-oxv48y00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-503093126',owner_user_name='tempest-SnapshotDataIntegrityTests-503093126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8586e036aeec4849b3e7e232dae7010b',uuid=4284cf45-9291-4fa4-9264-3aa4f8debafd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Converting VIF {"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:11:2d,bridge_name='br-int',has_traffic_filtering=True,id=ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c,network=Network(c96fda03-0a55-43a3-916e-acf3687e2898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceaa53a8-27') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.objects.instance [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'pci_devices' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] End _get_guest_xml xml=<domain type="kvm">
Oct 24 00:16:34 user nova-compute[74482]:   <uuid>4284cf45-9291-4fa4-9264-3aa4f8debafd</uuid>
Oct 24 00:16:34 user nova-compute[74482]:   <name>instance-00000035</name>
Oct 24 00:16:34 user nova-compute[74482]:   <memory>524288</memory>
Oct 24 00:16:34 user nova-compute[74482]:   <vcpu>1</vcpu>
Oct 24 00:16:34 user nova-compute[74482]:   <metadata>
Oct 24 00:16:34 user nova-compute[74482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 24 00:16:34 user nova-compute[74482]:       <nova:package version="0.0.0"/>
Oct 24 00:16:34 user nova-compute[74482]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1487705987</nova:name>
Oct 24 00:16:34 user nova-compute[74482]:       <nova:creationTime>2023-10-24 00:16:34</nova:creationTime>
Oct 24 00:16:34 user nova-compute[74482]:       <nova:flavor name="m1.tiny">
Oct 24 00:16:34 user nova-compute[74482]:         <nova:memory>512</nova:memory>
Oct 24 00:16:34 user nova-compute[74482]:         <nova:disk>1</nova:disk>
Oct 24 00:16:34 user nova-compute[74482]:         <nova:swap>0</nova:swap>
Oct 24 00:16:34 user nova-compute[74482]:         <nova:ephemeral>0</nova:ephemeral>
Oct 24 00:16:34 user nova-compute[74482]:         <nova:vcpus>1</nova:vcpus>
Oct 24 00:16:34 user nova-compute[74482]:       </nova:flavor>
Oct 24 00:16:34 user nova-compute[74482]:       <nova:owner>
Oct 24 00:16:34 user nova-compute[74482]:         <nova:user uuid="8586e036aeec4849b3e7e232dae7010b">tempest-SnapshotDataIntegrityTests-503093126-project-member</nova:user>
Oct 24 00:16:34 user nova-compute[74482]:         <nova:project uuid="bef65af6d89d4a52861e693e717bf051">tempest-SnapshotDataIntegrityTests-503093126</nova:project>
Oct 24 00:16:34 user nova-compute[74482]:       </nova:owner>
Oct 24 00:16:34 user nova-compute[74482]:       <nova:root type="image" uuid="8269c4ae-64d4-478e-8976-b601953bda88"/>
Oct 24 00:16:34 user nova-compute[74482]:       <nova:ports>
Oct 24 00:16:34 user nova-compute[74482]:         <nova:port uuid="ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c">
Oct 24 00:16:34 user nova-compute[74482]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 24 00:16:34 user nova-compute[74482]:         </nova:port>
Oct 24 00:16:34 user nova-compute[74482]:       </nova:ports>
Oct 24 00:16:34 user nova-compute[74482]:     </nova:instance>
Oct 24 00:16:34 user nova-compute[74482]:   </metadata>
Oct 24 00:16:34 user nova-compute[74482]:   <sysinfo type="smbios">
Oct 24 00:16:34 user nova-compute[74482]:     <system>
Oct 24 00:16:34 user nova-compute[74482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 24 00:16:34 user nova-compute[74482]:       <entry name="product">OpenStack Nova</entry>
Oct 24 00:16:34 user nova-compute[74482]:       <entry name="version">0.0.0</entry>
Oct 24 00:16:34 user nova-compute[74482]:       <entry name="serial">4284cf45-9291-4fa4-9264-3aa4f8debafd</entry>
Oct 24 00:16:34 user nova-compute[74482]:       <entry name="uuid">4284cf45-9291-4fa4-9264-3aa4f8debafd</entry>
Oct 24 00:16:34 user nova-compute[74482]:       <entry name="family">Virtual Machine</entry>
Oct 24 00:16:34 user nova-compute[74482]:     </system>
Oct 24 00:16:34 user nova-compute[74482]:   </sysinfo>
Oct 24 00:16:34 user nova-compute[74482]:   <os>
Oct 24 00:16:34 user nova-compute[74482]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 24 00:16:34 user nova-compute[74482]:     <boot dev="hd"/>
Oct 24 00:16:34 user nova-compute[74482]:     <smbios mode="sysinfo"/>
Oct 24 00:16:34 user nova-compute[74482]:   </os>
Oct 24 00:16:34 user nova-compute[74482]:   <features>
Oct 24 00:16:34 user nova-compute[74482]:     <acpi/>
Oct 24 00:16:34 user nova-compute[74482]:     <apic/>
Oct 24 00:16:34 user nova-compute[74482]:     <vmcoreinfo/>
Oct 24 00:16:34 user nova-compute[74482]:   </features>
Oct 24 00:16:34 user nova-compute[74482]:   <clock offset="utc">
Oct 24 00:16:34 user nova-compute[74482]:     <timer name="pit" tickpolicy="delay"/>
Oct 24 00:16:34 user nova-compute[74482]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 24 00:16:34 user nova-compute[74482]:     <timer name="hpet" present="no"/>
Oct 24 00:16:34 user nova-compute[74482]:   </clock>
Oct 24 00:16:34 user nova-compute[74482]:   <cpu mode="custom" match="exact">
Oct 24 00:16:34 user nova-compute[74482]:     <model>Nehalem</model>
Oct 24 00:16:34 user nova-compute[74482]:     <topology sockets="1" cores="1" threads="1"/>
Oct 24 00:16:34 user nova-compute[74482]:   </cpu>
Oct 24 00:16:34 user nova-compute[74482]:   <devices>
Oct 24 00:16:34 user nova-compute[74482]:     <disk type="file" device="disk">
Oct 24 00:16:34 user nova-compute[74482]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 24 00:16:34 user nova-compute[74482]:       <source file="/opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk"/>
Oct 24 00:16:34 user nova-compute[74482]:       <target dev="vda" bus="virtio"/>
Oct 24 00:16:34 user nova-compute[74482]:     </disk>
Oct 24 00:16:34 user nova-compute[74482]:     <interface type="ethernet">
Oct 24 00:16:34 user nova-compute[74482]:       <mac address="fa:16:3e:f9:11:2d"/>
Oct 24 00:16:34 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:16:34 user nova-compute[74482]:       <mtu size="1442"/>
Oct 24 00:16:34 user nova-compute[74482]:       <target dev="tapceaa53a8-27"/>
Oct 24 00:16:34 user nova-compute[74482]:     </interface>
Oct 24 00:16:34 user nova-compute[74482]:     <serial type="pty">
Oct 24 00:16:34 user nova-compute[74482]:       <log file="/opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/console.log" append="off"/>
Oct 24 00:16:34 user nova-compute[74482]:     </serial>
Oct 24 00:16:34 user nova-compute[74482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 24 00:16:34 user nova-compute[74482]:     <video>
Oct 24 00:16:34 user nova-compute[74482]:       <model type="virtio"/>
Oct 24 00:16:34 user nova-compute[74482]:     </video>
Oct 24 00:16:34 user nova-compute[74482]:     <rng model="virtio">
Oct 24 00:16:34 user nova-compute[74482]:       <backend model="random">/dev/urandom</backend>
Oct 24 00:16:34 user nova-compute[74482]:     </rng>
Oct 24 00:16:34 user nova-compute[74482]:     <controller type="usb" index="0" model="none"/>
Oct 24 00:16:34 user nova-compute[74482]:     <memballoon model="virtio">
Oct 24 00:16:34 user nova-compute[74482]:       <stats period="10"/>
Oct 24 00:16:34 user nova-compute[74482]:     </memballoon>
Oct 24 00:16:34 user nova-compute[74482]:   </devices>
Oct 24 00:16:34 user nova-compute[74482]: </domain>
Oct 24 00:16:34 user nova-compute[74482]:  {{(pid=74482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:16:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1487705987',display_name='tempest-SnapshotDataIntegrityTests-server-1487705987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1487705987',id=53,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt+9VDTuXBY0ZR4sfMNf5Rrlo6rOZ/QgEB/hH1bWLdNs9ulZU4wraEl/cgkVoGR1V4y0Edev8oPWUfOk/cNvGE/YsDSq4c+wh0153cbhF398hdsRfkVdFAKkeBifdg9XQ==',key_name='tempest-keypair-650341276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef65af6d89d4a52861e693e717bf051',ramdisk_id='',reservation_id='r-oxv48y00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-503093126',owner_user_name='tempest-SnapshotDataIntegrityTests-503093126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-24T00:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8586e036aeec4849b3e7e232dae7010b',uuid=4284cf45-9291-4fa4-9264-3aa4f8debafd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Converting VIF {"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:11:2d,bridge_name='br-int',has_traffic_filtering=True,id=ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c,network=Network(c96fda03-0a55-43a3-916e-acf3687e2898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceaa53a8-27') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG os_vif [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:11:2d,bridge_name='br-int',has_traffic_filtering=True,id=ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c,network=Network(c96fda03-0a55-43a3-916e-acf3687e2898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceaa53a8-27') {{(pid=74482) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0337e52f-462b-589d-ab51-dc0776673f34', '_type': 'linux-noop'}}, row=False) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapceaa53a8-27, may_exist=True, interface_attrs={}) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapceaa53a8-27, col_values=(('qos', UUID('49be437e-6fe6-44f8-b123-e0a2f57e2c01')),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapceaa53a8-27, col_values=(('external_ids', {'iface-id': 'ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:11:2d', 'vm-uuid': '4284cf45-9291-4fa4-9264-3aa4f8debafd'}),), if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:34 user nova-compute[74482]: INFO os_vif [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:11:2d,bridge_name='br-int',has_traffic_filtering=True,id=ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c,network=Network(c96fda03-0a55-43a3-916e-acf3687e2898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceaa53a8-27')
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No VIF found with MAC fa:16:3e:f9:11:2d, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.neutron [req-c5db307f-3cd3-47f6-bffa-b4b46acf28bc req-f0db41ee-3a30-4de9-a7b1-5bae1f8bea38 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated VIF entry in instance network info cache for port ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG nova.network.neutron [req-c5db307f-3cd3-47f6-bffa-b4b46acf28bc req-f0db41ee-3a30-4de9-a7b1-5bae1f8bea38 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:16:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-c5db307f-3cd3-47f6-bffa-b4b46acf28bc req-f0db41ee-3a30-4de9-a7b1-5bae1f8bea38 service nova] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:16:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-0214805d-97c7-473e-a52a-a8118a0906f1 req-d0c8f58a-fa7c-48b9-9a90-a08e1b2ede01 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received event network-vif-plugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:16:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0214805d-97c7-473e-a52a-a8118a0906f1 req-d0c8f58a-fa7c-48b9-9a90-a08e1b2ede01 service nova] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0214805d-97c7-473e-a52a-a8118a0906f1 req-d0c8f58a-fa7c-48b9-9a90-a08e1b2ede01 service nova] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0214805d-97c7-473e-a52a-a8118a0906f1 req-d0c8f58a-fa7c-48b9-9a90-a08e1b2ede01 service nova] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:36 user nova-compute[74482]: DEBUG nova.compute.manager [req-0214805d-97c7-473e-a52a-a8118a0906f1 req-d0c8f58a-fa7c-48b9-9a90-a08e1b2ede01 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] No waiting events found dispatching network-vif-plugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:16:36 user nova-compute[74482]: WARNING nova.compute.manager [req-0214805d-97c7-473e-a52a-a8118a0906f1 req-d0c8f58a-fa7c-48b9-9a90-a08e1b2ede01 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received unexpected event network-vif-plugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c for instance with vm_state building and task_state spawning.
Oct 24 00:16:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:37 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-1cf5e99a-bc81-4b59-a4f8-f2ce08262f77 req-2dc93d25-893d-4306-ae6f-fb61c061ce4d service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received event network-vif-plugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:16:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1cf5e99a-bc81-4b59-a4f8-f2ce08262f77 req-2dc93d25-893d-4306-ae6f-fb61c061ce4d service nova] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:16:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1cf5e99a-bc81-4b59-a4f8-f2ce08262f77 req-2dc93d25-893d-4306-ae6f-fb61c061ce4d service nova] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:16:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-1cf5e99a-bc81-4b59-a4f8-f2ce08262f77 req-2dc93d25-893d-4306-ae6f-fb61c061ce4d service nova] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:38 user nova-compute[74482]: DEBUG nova.compute.manager [req-1cf5e99a-bc81-4b59-a4f8-f2ce08262f77 req-2dc93d25-893d-4306-ae6f-fb61c061ce4d service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] No waiting events found dispatching network-vif-plugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:16:38 user nova-compute[74482]: WARNING nova.compute.manager [req-1cf5e99a-bc81-4b59-a4f8-f2ce08262f77 req-2dc93d25-893d-4306-ae6f-fb61c061ce4d service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received unexpected event network-vif-plugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c for instance with vm_state building and task_state spawning.
Oct 24 00:16:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Instance event wait completed in 0 seconds for  {{(pid=74482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Guest created on hypervisor {{(pid=74482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 24 00:16:39 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Instance spawned successfully.
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Found default for hw_cdrom_bus of ide {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Found default for hw_disk_bus of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Found default for hw_input_bus of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Found default for hw_pointer_model of None {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Found default for hw_video_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Found default for hw_vif_model of virtio {{(pid=74482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:39 user nova-compute[74482]: INFO nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Took 7.17 seconds to spawn the instance on the hypervisor.
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Checking state {{(pid=74482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:39 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 24 00:16:39 user nova-compute[74482]: INFO nova.compute.manager [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Took 8.36 seconds to build instance.
Oct 24 00:16:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-594ad270-8419-4bff-bdfd-868d338483bc tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.528s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:16:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:16:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:16:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:16:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:11 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:17:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:17:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:17:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:17:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:17:13 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:17:13 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:17:13 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:17:14 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:17:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:17:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:17:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:17:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:17:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:17:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:17:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:17:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:17:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:17:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:17:31 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:17:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:17:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:17:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:17:31 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:17:31 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:17:32 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:17:32 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:17:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=24.838809967041016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4284cf45-9291-4fa4-9264-3aa4f8debafd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:17:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:17:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:17:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:17:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:17:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:17:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:17:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:17:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:17:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:17:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:13 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:13 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:18:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:18:14 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:18:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:18:14 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:18:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:18:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:18:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:18:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:18:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:18 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-0854f430-b468-4452-8ed8-01ee8e9ac9d9 req-5a112fa8-f118-4c73-b332-0c0a05744d63 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received event network-changed-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:18:22 user nova-compute[74482]: DEBUG nova.compute.manager [req-0854f430-b468-4452-8ed8-01ee8e9ac9d9 req-5a112fa8-f118-4c73-b332-0c0a05744d63 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Refreshing instance network info cache due to event network-changed-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c. {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 24 00:18:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0854f430-b468-4452-8ed8-01ee8e9ac9d9 req-5a112fa8-f118-4c73-b332-0c0a05744d63 service nova] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:18:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0854f430-b468-4452-8ed8-01ee8e9ac9d9 req-5a112fa8-f118-4c73-b332-0c0a05744d63 service nova] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:18:22 user nova-compute[74482]: DEBUG nova.network.neutron [req-0854f430-b468-4452-8ed8-01ee8e9ac9d9 req-5a112fa8-f118-4c73-b332-0c0a05744d63 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Refreshing network info cache for port ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 24 00:18:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-0854f430-b468-4452-8ed8-01ee8e9ac9d9 req-5a112fa8-f118-4c73-b332-0c0a05744d63 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated VIF entry in instance network info cache for port ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c. {{(pid=74482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 24 00:18:23 user nova-compute[74482]: DEBUG nova.network.neutron [req-0854f430-b468-4452-8ed8-01ee8e9ac9d9 req-5a112fa8-f118-4c73-b332-0c0a05744d63 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:18:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-0854f430-b468-4452-8ed8-01ee8e9ac9d9 req-5a112fa8-f118-4c73-b332-0c0a05744d63 service nova] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:18:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:18:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:18:30 user nova-compute[74482]: INFO nova.compute.manager [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attaching volume 68d446f0-5aa6-42b0-84db-9fb58256f700 to /dev/vdb
Oct 24 00:18:30 user nova-compute[74482]: DEBUG os_brick.utils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78e8c0b-ca67-4d6e-ad3f-17ad41c4bb5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba017ba-52b0-44b8-adf0-7560907a2c32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18d45f5-874f-4dd4-814d-f5e9d642d1f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8443544-12f3-4c51-a09d-f567f48782a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:18:30 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 24 00:18:30 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02815bf-2ff8-4c35-a8d9-891b3ce5bfdc]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG os_brick.utils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:18:30 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating existing volume attachment record: 731c3906-4949-48cb-994e-c397f3ee5fd5 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 24 00:18:33 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:18:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:18:33 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:18:33 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:18:33 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:34 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:18:34 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:18:34 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=24.835857391357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:18:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:18:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4284cf45-9291-4fa4-9264-3aa4f8debafd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:18:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:18:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:18:35 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:18:35 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:18:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:18:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:18:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:44 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:18:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQequIkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:18:47 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:18:47 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:18:47 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7083fb8b-aca8-4140-984a-930b14f3d199]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 24 00:18:47 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2f25e6-971a-4df1-b760-624c79c76b4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700] added
Oct 24 00:18:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6749ed-c145-4daa-84d6-93caf109cd81]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9867a04d-ead5-4e1b-90a6-600f09ab3de4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQequIkh {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQequIkh" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f059135-5945-4156-acce-458b4acf77a9]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQequIkh'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4392503-f7f6-4a45-94be-1c80fc0b7e5f]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7b539f-b470-4c4c-9c7f-2c3b4e451dff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:18:47 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:18:47 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:18:47 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 24 00:18:47 user nova-compute[74482]: 
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8642a1d5-e79e-485c-8484-23ed95d0ef42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700, portal: 172.16.0.220,3260]
Oct 24 00:18:47 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700, portal: 172.16.0.220,3260] successful.
Oct 24 00:18:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c0d02-be7c-41d9-8130-67ed43befb61]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a79377-f21e-4745-aaf6-21df108bf7b0]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 (non-flash)
Oct 24 00:18:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 (non-flash)
Oct 24 00:18:47 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d0412d-2982-4306-af5d-a8f006233416]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:18:47 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQequIkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 24 00:18:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:18:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26134616336323632', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:18:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134616336323632', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 24 00:18:48 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:18:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] attach device xml: <disk type="block" device="disk">
Oct 24 00:18:48 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:18:48 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:18:48 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:18:48 user nova-compute[74482]:   <serial>68d446f0-5aa6-42b0-84db-9fb58256f700</serial>
Oct 24 00:18:48 user nova-compute[74482]: </disk>
Oct 24 00:18:48 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 24 00:18:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:18:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:18:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No VIF found with MAC fa:16:3e:f9:11:2d, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:18:49 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4a931597-f45d-4416-8aec-70a1f87cdd98 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.643s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:18:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:18:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:18:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:14 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:19:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:19:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:19:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:19:15 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:19:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:19:15 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:19:15 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:19:15 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:19:16 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:19:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:19:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:19:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:19:16 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:19:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:19:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:19:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:19:21 user nova-compute[74482]: INFO nova.compute.manager [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Detaching volume 68d446f0-5aa6-42b0-84db-9fb58256f700
Oct 24 00:19:21 user nova-compute[74482]: INFO nova.virt.block_device [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attempting to driver detach volume 68d446f0-5aa6-42b0-84db-9fb58256f700 from mountpoint /dev/vdb
Oct 24 00:19:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Attempting to detach device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 24 00:19:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] detach device xml: <disk type="block" device="disk">
Oct 24 00:19:21 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:19:21 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:19:21 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:19:21 user nova-compute[74482]:   <serial>68d446f0-5aa6-42b0-84db-9fb58256f700</serial>
Oct 24 00:19:21 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 24 00:19:21 user nova-compute[74482]: </disk>
Oct 24 00:19:21 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 24 00:19:21 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully detached device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the persistent domain config.
Oct 24 00:19:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 24 00:19:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] detach device xml: <disk type="block" device="disk">
Oct 24 00:19:21 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:19:21 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:19:21 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:19:21 user nova-compute[74482]:   <serial>68d446f0-5aa6-42b0-84db-9fb58256f700</serial>
Oct 24 00:19:21 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 24 00:19:21 user nova-compute[74482]: </disk>
Oct 24 00:19:21 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 24 00:19:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:19:21 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 24 00:19:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:19:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:19:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:19:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:19:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:19:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:19:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:19:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:19:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:19:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:19:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:19:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:19:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:19:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:19:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=24.834030151367188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4284cf45-9291-4fa4-9264-3aa4f8debafd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:19:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:19:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:19:41 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd is timed out.
Oct 24 00:19:42 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully detached device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the live domain config.
Oct 24 00:19:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQequIkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:19:42 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4d170e-cfdd-4ce1-b116-070ff6543da9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 24 00:19:42 user nova-compute[74482]: No targets found.
Oct 24 00:19:42 user nova-compute[74482]: iSNS:
Oct 24 00:19:42 user nova-compute[74482]: No targets found.
Oct 24 00:19:42 user nova-compute[74482]: STATIC:
Oct 24 00:19:42 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700
Oct 24 00:19:42 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:19:42 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:19:42 user nova-compute[74482]: FIRMWARE:
Oct 24 00:19:42 user nova-compute[74482]: No targets found.
Oct 24 00:19:42 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 24 00:19:42 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 24 00:19:42 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efb7b57-e3a2-4f5d-8b11-c7bd084b5c26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2b3c7e-c9ec-4e94-9f1d-6e9a339950d1]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 (non-flash)
Oct 24 00:19:42 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 (non-flash)
Oct 24 00:19:42 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308fcb27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e98f1f5-11e7-4792-8f82-d695aefd1329]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a953f7-b2a2-447b-b272-41a10eddc2e5]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274ee19-e917-4acb-a731-58e590d7c721]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37d4557-6a5c-49b0-91a7-21ec268e8e3f]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d0b3b-67b1-44c1-9b48-ffb37b076ba1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c71a7d-adc0-4b5f-9452-068f8a2fab3c]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700, portal: 172.16.0.220,3260]
Oct 24 00:19:42 user nova-compute[74482]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700, portal: 172.16.0.220,3260] successful.
Oct 24 00:19:42 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d446f0-5aa6-42b0-84db-9fb58256f700 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27e7340-4ca0-4e11-afd8-35f0f264bee4]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== disconnect_volume: return (314ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:19:42 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 24 00:19:43 user nova-compute[74482]: DEBUG nova.objects.instance [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:19:43 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-0c13da5d-5361-4e4b-90b9-e4ea974f0dc6 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.038s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:19:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:19:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:19:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:19:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:20:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:20:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:20:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:20:16 user nova-compute[74482]: INFO nova.compute.manager [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attaching volume 6451a9e3-6052-4447-b042-a9a6a6eaebd4 to /dev/vdb
Oct 24 00:20:16 user nova-compute[74482]: DEBUG os_brick.utils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a93fad8-583a-444b-a9c7-f61e29c6848c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b7ef2a-884a-4523-b876-8270a59883b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ef4fff-aebf-41b7-8048-ea96f11530ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb1f4e7-8467-44b3-83ad-ab254e44816f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:20:16 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 24 00:20:16 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a836489c-428e-4f68-8428-7425a7bae04c]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG os_brick.utils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:20:16 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating existing volume attachment record: d19969b1-d6a1-45e0-843b-b5da10d10bd7 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 24 00:20:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:20:17 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:20:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:20:17 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:20:17 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:20:17 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:20:18 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:20:18 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:20:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:20:18 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:18 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:20:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:20:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:20:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DctWoVdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:20:32 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:20:32 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:20:32 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e37ef0d-55d1-41fd-a8bd-0b5fbe9251c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 24 00:20:32 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce636015-1025-4163-9ade-7e87e4b21ecd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4] added
Oct 24 00:20:32 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44a9e28-2887-4004-a0bf-1e0d9a04cb92]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade6a5e-5721-4edc-ac41-539665ee91d5]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DctWoVdp {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DctWoVdp" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf2a8d0-644b-4c09-8318-b39952913e44]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DctWoVdp'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc6a2ba-21fb-480a-bbc5-d99707b24394]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[327b7d90-a260-4d26-9067-69dd50b6b235]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:20:32 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:20:32 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:20:32 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 24 00:20:32 user nova-compute[74482]: 
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe02dd8-4e33-467f-a96e-2a06d9005a6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4, portal: 172.16.0.220,3260]
Oct 24 00:20:32 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4, portal: 172.16.0.220,3260] successful.
Oct 24 00:20:32 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e38aeef-2813-438b-bcd6-2c7cc4740ee7]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b15056-1d03-4e08-b4e1-cbbf95209f5d]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 (non-flash)
Oct 24 00:20:32 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 (non-flash)
Oct 24 00:20:32 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[078d9684-53ce-4785-947e-e2c2cc5e6229]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:20:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DctWoVdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 24 00:20:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:20:33 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23332323932656562', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:20:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332323932656562', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 24 00:20:33 user nova-compute[74482]: DEBUG nova.objects.instance [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:20:33 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] attach device xml: <disk type="block" device="disk">
Oct 24 00:20:33 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:20:33 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:20:33 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:20:33 user nova-compute[74482]:   <serial>6451a9e3-6052-4447-b042-a9a6a6eaebd4</serial>
Oct 24 00:20:33 user nova-compute[74482]: </disk>
Oct 24 00:20:33 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No VIF found with MAC fa:16:3e:f9:11:2d, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-e5e5e838-68be-4fb0-b416-568be8ee0e06 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.554s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:20:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:20:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:20:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:20:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:20:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 24 00:20:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:20:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=24.833038330078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:20:36 user nova-compute[74482]: INFO nova.compute.manager [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Detaching volume 6451a9e3-6052-4447-b042-a9a6a6eaebd4
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4284cf45-9291-4fa4-9264-3aa4f8debafd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:20:36 user nova-compute[74482]: INFO nova.virt.block_device [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attempting to driver detach volume 6451a9e3-6052-4447-b042-a9a6a6eaebd4 from mountpoint /dev/vdb
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Attempting to detach device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] detach device xml: <disk type="block" device="disk">
Oct 24 00:20:36 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:20:36 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:20:36 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:20:36 user nova-compute[74482]:   <serial>6451a9e3-6052-4447-b042-a9a6a6eaebd4</serial>
Oct 24 00:20:36 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 24 00:20:36 user nova-compute[74482]: </disk>
Oct 24 00:20:36 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 24 00:20:36 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully detached device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the persistent domain config.
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 24 00:20:36 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] detach device xml: <disk type="block" device="disk">
Oct 24 00:20:36 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:20:36 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:20:36 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:20:36 user nova-compute[74482]:   <serial>6451a9e3-6052-4447-b042-a9a6a6eaebd4</serial>
Oct 24 00:20:36 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 24 00:20:36 user nova-compute[74482]: </disk>
Oct 24 00:20:36 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 24 00:20:37 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 24 00:20:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:45 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:20:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:20:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:20:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:20:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:20:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:20:57 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd is timed out.
Oct 24 00:20:57 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully detached device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the live domain config.
Oct 24 00:20:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DctWoVdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:20:57 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce7bc65-d2e5-4c4a-aa27-91921264863f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 24 00:20:57 user nova-compute[74482]: No targets found.
Oct 24 00:20:57 user nova-compute[74482]: iSNS:
Oct 24 00:20:57 user nova-compute[74482]: No targets found.
Oct 24 00:20:57 user nova-compute[74482]: STATIC:
Oct 24 00:20:57 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4
Oct 24 00:20:57 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:20:57 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:20:57 user nova-compute[74482]: FIRMWARE:
Oct 24 00:20:57 user nova-compute[74482]: No targets found.
Oct 24 00:20:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 24 00:20:57 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 24 00:20:57 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b4bece-9fba-4ced-ad39-41d7ed671735]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3765562c-492e-4aa0-9885-e5d5b3ceffcd]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 (non-flash)
Oct 24 00:20:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 (non-flash)
Oct 24 00:20:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c754670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1559e48-7147-4f0b-9e7c-b011223f8179]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5088eba5-bbf0-4708-9b68-9237439b3571]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ae1c7c-cab5-4bc6-bae4-b8307932509b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ea0fdb-75a1-4097-b9fc-631f2bc252a2]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5c5e37-091b-408d-befb-3753ff5781ce]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e167938e-3b0e-4c93-80ce-0b16167c702d]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4, portal: 172.16.0.220,3260]
Oct 24 00:20:57 user nova-compute[74482]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4, portal: 172.16.0.220,3260] successful.
Oct 24 00:20:57 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6451a9e3-6052-4447-b042-a9a6a6eaebd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29c5dba-4f3f-40d2-8f54-94aaa4131701]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== disconnect_volume: return (262ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:20:57 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 24 00:20:58 user nova-compute[74482]: DEBUG nova.objects.instance [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:20:58 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-ebad60df-780c-4ff9-833a-8bd00a9793c8 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.878s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:20:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:14 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:15 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:21:19 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:20 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:21:20 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:21:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:21:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:20 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:21:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:24 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:21:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:21:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:21:29 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:21:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:21:31 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:21:31 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:21:32 user nova-compute[74482]: INFO nova.compute.manager [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attaching volume fbadbb48-2de0-4c2e-914d-2ab625a5078c to /dev/vdb
Oct 24 00:21:32 user nova-compute[74482]: DEBUG os_brick.utils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb12df-7b45-4b40-aa9e-8ac0663134df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e1810-d1e7-4c17-80f3-52ad7906e665]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[405cef6d-2685-4843-8028-c2162da52d8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0624ad0e-10c7-471c-9fab-9455e0358bc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:21:32 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c380971-1e7b-4714-989a-5337f2344749]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG os_brick.utils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating existing volume attachment record: bb9fa02b-3302-42d9-9b5d-713daa916890 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 24 00:21:32 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 24 00:21:34 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] There are 0 instances to clean {{(pid=74482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 24 00:21:34 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:21:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:21:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:21:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:21:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:21:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=24.824356079101562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4284cf45-9291-4fa4-9264-3aa4f8debafd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing inventories for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating ProviderTree inventory for provider 1a363ec4-e397-463d-b641-d9da25942aa6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Updating inventory in ProviderTree for provider 1a363ec4-e397-463d-b641-d9da25942aa6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing aggregate associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, aggregates: None {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Refreshing trait associations for resource provider 1a363ec4-e397-463d-b641-d9da25942aa6, traits: HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE {{(pid=74482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:21:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:21:39 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:41 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:41 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Cleaning up deleted instances with incomplete migration  {{(pid=74482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 24 00:21:44 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnfdmkiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:21:48 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:21:48 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:21:48 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df1fba-ab18-471c-a546-bc9ddbaedcba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 24 00:21:48 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5684057d-77f9-4d7d-9b67-871093d5577b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c] added
Oct 24 00:21:48 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c3d1b8-f2fb-41f9-9baa-e1629603af59]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccebe962-2929-4dcd-b3fb-3ec91d2cbe22]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gnfdmkiq {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gnfdmkiq" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a02db5b-905d-40bc-8be7-111951da2753]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gnfdmkiq'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[13005d2a-8d05-46d9-9869-60ee145570ea]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e84bf65-622b-4f60-a539-8207d577879b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:21:48 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:21:48 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:21:48 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 24 00:21:48 user nova-compute[74482]: 
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e9035-ff4b-4c61-8490-09a5c88f9ab8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c, portal: 172.16.0.220,3260]
Oct 24 00:21:48 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c, portal: 172.16.0.220,3260] successful.
Oct 24 00:21:48 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b2886a-d5e7-40fe-8d6e-a7e92d9e5440]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a540285e-be94-42d0-a584-be088973bf1d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c (non-flash)
Oct 24 00:21:48 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c (non-flash)
Oct 24 00:21:48 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e578ec-187f-4e88-bcaa-8d1b7cea99f9]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:21:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnfdmkiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 24 00:21:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:21:49 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23064383961666433', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:21:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064383961666433', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 24 00:21:49 user nova-compute[74482]: DEBUG nova.objects.instance [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:21:49 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] attach device xml: <disk type="block" device="disk">
Oct 24 00:21:49 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:21:49 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:21:49 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:21:49 user nova-compute[74482]:   <serial>fbadbb48-2de0-4c2e-914d-2ab625a5078c</serial>
Oct 24 00:21:49 user nova-compute[74482]: </disk>
Oct 24 00:21:49 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 24 00:21:49 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:21:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:21:50 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No VIF found with MAC fa:16:3e:f9:11:2d, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:21:50 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-4009b5bb-4ec4-431c-a89a-0f8b54684cd4 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.221s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:21:52 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:21:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:21:53 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:21:53 user nova-compute[74482]: INFO nova.compute.manager [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Detaching volume fbadbb48-2de0-4c2e-914d-2ab625a5078c
Oct 24 00:21:53 user nova-compute[74482]: INFO nova.virt.block_device [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attempting to driver detach volume fbadbb48-2de0-4c2e-914d-2ab625a5078c from mountpoint /dev/vdb
Oct 24 00:21:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Attempting to detach device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 24 00:21:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] detach device xml: <disk type="block" device="disk">
Oct 24 00:21:53 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:21:53 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:21:53 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:21:53 user nova-compute[74482]:   <serial>fbadbb48-2de0-4c2e-914d-2ab625a5078c</serial>
Oct 24 00:21:53 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 24 00:21:53 user nova-compute[74482]: </disk>
Oct 24 00:21:53 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 24 00:21:53 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully detached device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the persistent domain config.
Oct 24 00:21:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 24 00:21:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] detach device xml: <disk type="block" device="disk">
Oct 24 00:21:53 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:21:53 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:21:53 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:21:53 user nova-compute[74482]:   <serial>fbadbb48-2de0-4c2e-914d-2ab625a5078c</serial>
Oct 24 00:21:53 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 24 00:21:53 user nova-compute[74482]: </disk>
Oct 24 00:21:53 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 24 00:21:53 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 24 00:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:21:54 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:21:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:21:59 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:22:04 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:22:09 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:22:13 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd is timed out.
Oct 24 00:22:13 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully detached device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the live domain config.
Oct 24 00:22:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gnfdmkiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:22:13 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f73c3e-a041-4323-ac9f-b697ab3716da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 24 00:22:13 user nova-compute[74482]: No targets found.
Oct 24 00:22:13 user nova-compute[74482]: iSNS:
Oct 24 00:22:13 user nova-compute[74482]: No targets found.
Oct 24 00:22:13 user nova-compute[74482]: STATIC:
Oct 24 00:22:13 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c
Oct 24 00:22:13 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:22:13 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:22:13 user nova-compute[74482]: FIRMWARE:
Oct 24 00:22:13 user nova-compute[74482]: No targets found.
Oct 24 00:22:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 24 00:22:13 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 24 00:22:13 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ab7c84-e06b-41ad-aff0-3523627da90f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[98498519-9b00-43a5-9d50-44b9000776f6]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c (non-flash)
Oct 24 00:22:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c (non-flash)
Oct 24 00:22:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c5ba5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a1cce0-9d1d-4bf7-a6f1-382001fef10c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdece325-bfec-4996-84ad-818ace24d753]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3e9f0f-b55e-4ecd-a632-abfc293bf44a]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f167694-f5c2-4e79-ba09-c9a318e834e6]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3237869f-8b17-49ee-b8e6-7bfd4065859e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c26c13b-b170-49da-bdd2-f0aefde84849]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c, portal: 172.16.0.220,3260]
Oct 24 00:22:13 user nova-compute[74482]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c, portal: 172.16.0.220,3260] successful.
Oct 24 00:22:13 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbadbb48-2de0-4c2e-914d-2ab625a5078c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc613071-0c2d-4df2-b008-0db8cce967f3]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== disconnect_volume: return (288ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:22:13 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 24 00:22:14 user nova-compute[74482]: DEBUG nova.objects.instance [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:22:14 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-975b8bda-f002-41bf-91a2-889748a4cf18 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:22:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:22:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:22:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:22:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:22:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:22:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:22:16 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:19 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:19 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:22:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:22:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:22:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:22:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:22:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:22:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:22:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:22:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:22:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:22:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:22:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:22:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:22:34 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:22:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:22:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:22:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=24.823528289794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4284cf45-9291-4fa4-9264-3aa4f8debafd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:22:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:22:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:22:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG nova.objects.instance [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:22:48 user nova-compute[74482]: INFO nova.compute.manager [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attaching volume 7d455b12-ccdd-4804-a44b-0dea885aaaea to /dev/vdb
Oct 24 00:22:48 user nova-compute[74482]: DEBUG os_brick.utils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e04a24-2873-4910-b0c9-6a464332cf1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2b9b91fd5724\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27d48f1-d579-4736-96c6-9d598d4fd085]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[082a9a8e-04be-4186-9149-3b9c5e1314eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[693eb286-4f4b-4355-b03b-6269558a6a51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Running cmd (subprocess): nvme version {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] 'nvme version' failed. Not Retrying. {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] nvme not present on system {{(pid=74482) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 24 00:22:48 user nova-compute[74482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 24 00:22:48 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de34ffa-4988-430a-8ef5-b69ef50b5a42]: (4, '') {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74482) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] LIGHTOS: no hostnqn found. {{(pid=74482) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG os_brick.utils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2b9b91fd5724', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:22:48 user nova-compute[74482]: DEBUG nova.virt.block_device [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating existing volume attachment record: 01483b5f-9660-4310-b25c-71aa891a7a66 {{(pid=74482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 24 00:22:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:22:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:22:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:22:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Calling os-brick to attach iSCSI Volume {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVQXnskT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:23:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:23:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:23:04 user nova-compute[74482]: INFO os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec43bd2-e59f-485b-860a-f7b189cbaea9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 24 00:23:04 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --interface default --op new {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9b9e47-516a-44bf-b2c8-21caa3eddb09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea] added\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea] added
Oct 24 00:23:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4fc63f-0db7-43da-a52e-f753563aaece]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bc70c5-884d-49a9-bd28-4c2e857959fc]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVQXnskT {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVQXnskT" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[11345552-271b-4c89-a613-e3051892113e]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FVQXnskT'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d524eb8-0a61-4104-992f-9928253f002b]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a769e2e-feb9-4b4b-8936-01ba8a923ac6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:23:04 user nova-compute[74482]:  {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 24 00:23:04 user nova-compute[74482]:  {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:23:04 user nova-compute[74482]: WARNING os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 24 00:23:04 user nova-compute[74482]: 
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --login {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7443249-d9f8-4a2a-af93-5d76475837ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea, portal: 172.16.0.220,3260]
Oct 24 00:23:04 user nova-compute[74482]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea, portal: 172.16.0.220,3260] successful.
Oct 24 00:23:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e131db8-a10b-4445-84d3-92fab4b63065]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4543a499-4ee0-48e8-90ab-65fa4ce4afef]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea (non-flash)
Oct 24 00:23:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea (non-flash)
Oct 24 00:23:04 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Connected to 172.16.0.220:3260 {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74482) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74482) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f35e87e-acc9-4d04-98a3-92225bfbb724]: (4, ('- - 0', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74482) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 24 00:23:04 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVQXnskT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74482) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 24 00:23:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:23:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:23:05 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26534633263333264', 'path': '/dev/sdb'} {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:23:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534633263333264', 'path': '/dev/sdb'} {{(pid=74482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 24 00:23:05 user nova-compute[74482]: DEBUG nova.objects.instance [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:23:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] attach device xml: <disk type="block" device="disk">
Oct 24 00:23:05 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:23:05 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:23:05 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:23:05 user nova-compute[74482]:   <serial>7d455b12-ccdd-4804-a44b-0dea885aaaea</serial>
Oct 24 00:23:05 user nova-compute[74482]: </disk>
Oct 24 00:23:05 user nova-compute[74482]:  {{(pid=74482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 24 00:23:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:23:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 24 00:23:05 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] No VIF found with MAC fa:16:3e:f9:11:2d, not building metadata {{(pid=74482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 24 00:23:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-5cb9333d-c4c1-4d28-a52f-586f87e8b5bf tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.607s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:23:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:23:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:23:08 user nova-compute[74482]: INFO nova.compute.manager [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Detaching volume 7d455b12-ccdd-4804-a44b-0dea885aaaea
Oct 24 00:23:08 user nova-compute[74482]: INFO nova.virt.block_device [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Attempting to driver detach volume 7d455b12-ccdd-4804-a44b-0dea885aaaea from mountpoint /dev/vdb
Oct 24 00:23:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Attempting to detach device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the persistent domain config. {{(pid=74482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 24 00:23:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] detach device xml: <disk type="block" device="disk">
Oct 24 00:23:08 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:23:08 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:23:08 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:23:08 user nova-compute[74482]:   <serial>7d455b12-ccdd-4804-a44b-0dea885aaaea</serial>
Oct 24 00:23:08 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 24 00:23:08 user nova-compute[74482]: </disk>
Oct 24 00:23:08 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 24 00:23:08 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully detached device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the persistent domain config.
Oct 24 00:23:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the live domain config. {{(pid=74482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 24 00:23:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.guest [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] detach device xml: <disk type="block" device="disk">
Oct 24 00:23:08 user nova-compute[74482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 24 00:23:08 user nova-compute[74482]:   <source dev="/dev/sdb"/>
Oct 24 00:23:08 user nova-compute[74482]:   <target dev="vdb" bus="virtio"/>
Oct 24 00:23:08 user nova-compute[74482]:   <serial>7d455b12-ccdd-4804-a44b-0dea885aaaea</serial>
Oct 24 00:23:08 user nova-compute[74482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 24 00:23:08 user nova-compute[74482]: </disk>
Oct 24 00:23:08 user nova-compute[74482]:  {{(pid=74482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 24 00:23:08 user nova-compute[74482]: DEBUG nova.virt.libvirt.driver [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 24 00:23:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:17 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:23:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:23:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:23:21 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:23:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:23:21 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:23:21 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:23:21 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:23:22 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:23:22 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:23:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:23:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:23:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:23:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:23:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:23:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4953-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:23:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:23:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:23:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:23:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:23:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:23:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:23:28 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd is timed out.
Oct 24 00:23:28 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully detached device vdb from instance 4284cf45-9291-4fa4-9264-3aa4f8debafd from the live domain config.
Oct 24 00:23:28 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] calling os-brick to detach iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 24 00:23:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f306c465690>, {'target_iqn': 'iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVQXnskT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 24 00:23:28 user nova-compute[74482]: WARNING os_brick.initiator.connectors.base [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 24 00:23:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 24 00:23:28 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 24 00:23:28 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8a21cf-6384-4469-8c51-eb3b20c1e775]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 24 00:23:29 user nova-compute[74482]: No targets found.
Oct 24 00:23:29 user nova-compute[74482]: iSNS:
Oct 24 00:23:29 user nova-compute[74482]: No targets found.
Oct 24 00:23:29 user nova-compute[74482]: STATIC:
Oct 24 00:23:29 user nova-compute[74482]: Target: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea
Oct 24 00:23:29 user nova-compute[74482]:         Portal: 172.16.0.220:3260,-1
Oct 24 00:23:29 user nova-compute[74482]:                 Iface Name: default
Oct 24 00:23:29 user nova-compute[74482]: FIRMWARE:
Oct 24 00:23:29 user nova-compute[74482]: No targets found.
Oct 24 00:23:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 24 00:23:29 user nova-compute[74482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 24 00:23:29 user nova-compute[74482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74482) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea', 0)] {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78fabed-6f6e-4414-be85-19b977ac784d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a608a4-5afa-4a05-b0a2-148bbb146427]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea (non-flash)\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea (non-flash)
Oct 24 00:23:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea (non-flash)
Oct 24 00:23:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306c442f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea'): ({'sdb'}, set())}) {{(pid=74482) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Removing single pathed devices sdb {{(pid=74482) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f05333-8bd2-4bb6-bd01-6e2c18cb4937]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2405c22c-9ddd-4611-9ae5-f8a677831fca]: (4, ('ok\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Flushing IO for device /dev/sdb {{(pid=74482) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96465470-aed6-4f75-9310-a2348d24e2b9]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74482) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[049d4c84-19d9-4e31-a01b-8b885afb439c]: (4, ('1', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.linuxscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] SCSI volumes sdb have been removed. {{(pid=74482) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea')] {{(pid=74482) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4266d20-ca58-4ddc-ab59-3bc636468dcb]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --logout {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6546c3f8-5803-49f4-b5a2-d173fb45ed38]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea, portal: 172.16.0.220,3260]
Oct 24 00:23:29 user nova-compute[74482]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea, portal: 172.16.0.220,3260] successful.
Oct 24 00:23:29 user nova-compute[74482]:  stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op delete {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d455b12-ccdd-4804-a44b-0dea885aaaea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG oslo.privsep.daemon [-] privsep: reply[508ab05a-00a8-4b52-98a6-d71a623cb2b1]: (4, ('', '')) {{(pid=86306) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74482) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.base [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] <== disconnect_volume: return (307ms) None {{(pid=74482) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 24 00:23:29 user nova-compute[74482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Disconnected iSCSI Volume {{(pid=74482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 24 00:23:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:30 user nova-compute[74482]: DEBUG nova.objects.instance [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'flavor' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:23:30 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-7e54ef54-1df3-41a8-9ddf-d37140dd1cdd tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.716s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:23:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:23:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:23:35 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:23:35 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:23:35 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:23:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:23:36 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=24.82248306274414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4284cf45-9291-4fa4-9264-3aa4f8debafd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:23:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:23:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:23:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:23:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:23:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:23:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:23:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:23:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:23:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:23:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:23:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:23:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:23:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:24:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:24:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:24:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:24:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:10 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:24:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:24:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:24:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:24:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:24:15 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:20 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:24:20 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:24:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:24:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 24 00:24:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquired lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 24 00:24:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Forcefully refreshing network info cache for instance {{(pid=74482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 24 00:24:23 user nova-compute[74482]: DEBUG nova.objects.instance [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lazy-loading 'info_cache' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:24:23 user nova-compute[74482]: DEBUG nova.network.neutron [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [{"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:24:23 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Releasing lock "refresh_cache-4284cf45-9291-4fa4-9264-3aa4f8debafd" {{(pid=74482) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 24 00:24:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updated the network info_cache for instance {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 24 00:24:23 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:23 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:24:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:24:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:24:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:24:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:24:25 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:26 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:28 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74482) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 24 00:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74482) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 24 00:24:30 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:35 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:24:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:24:36 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:24:36 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:24:36 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.processutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74482) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 24 00:24:37 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:24:37 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=24.821609497070312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Instance 4284cf45-9291-4fa4-9264-3aa4f8debafd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:24:37 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:24:40 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:24:45 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:24:50 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:24:50 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:24:55 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:05 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:25:06 user nova-compute[74482]: INFO nova.compute.manager [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Terminating instance
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.compute.manager [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Start destroying the instance on the hypervisor. {{(pid=74482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-ff30978c-e14c-4050-b94d-986313dc625b req-daaf2d82-8327-482f-863b-c2d243dea087 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received event network-vif-unplugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ff30978c-e14c-4050-b94d-986313dc625b req-daaf2d82-8327-482f-863b-c2d243dea087 service nova] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ff30978c-e14c-4050-b94d-986313dc625b req-daaf2d82-8327-482f-863b-c2d243dea087 service nova] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-ff30978c-e14c-4050-b94d-986313dc625b req-daaf2d82-8327-482f-863b-c2d243dea087 service nova] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-ff30978c-e14c-4050-b94d-986313dc625b req-daaf2d82-8327-482f-863b-c2d243dea087 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] No waiting events found dispatching network-vif-unplugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.compute.manager [req-ff30978c-e14c-4050-b94d-986313dc625b req-daaf2d82-8327-482f-863b-c2d243dea087 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received event network-vif-unplugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c for instance with task_state deleting. {{(pid=74482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [-] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Instance destroyed successfully.
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.objects.instance [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lazy-loading 'resources' on Instance uuid 4284cf45-9291-4fa4-9264-3aa4f8debafd {{(pid=74482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.virt.libvirt.vif [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-24T00:16:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1487705987',display_name='tempest-SnapshotDataIntegrityTests-server-1487705987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1487705987',id=53,image_ref='8269c4ae-64d4-478e-8976-b601953bda88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt+9VDTuXBY0ZR4sfMNf5Rrlo6rOZ/QgEB/hH1bWLdNs9ulZU4wraEl/cgkVoGR1V4y0Edev8oPWUfOk/cNvGE/YsDSq4c+wh0153cbhF398hdsRfkVdFAKkeBifdg9XQ==',key_name='tempest-keypair-650341276',keypairs=<?>,launch_index=0,launched_at=2023-10-24T00:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bef65af6d89d4a52861e693e717bf051',ramdisk_id='',reservation_id='r-oxv48y00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8269c4ae-64d4-478e-8976-b601953bda88',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-503093126',owner_user_name='tempest-SnapshotDataIntegrityTests-503093126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-24T00:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8586e036aeec4849b3e7e232dae7010b',uuid=4284cf45-9291-4fa4-9264-3aa4f8debafd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Converting VIF {"id": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "address": "fa:16:3e:f9:11:2d", "network": {"id": "c96fda03-0a55-43a3-916e-acf3687e2898", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-805419872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef65af6d89d4a52861e693e717bf051", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceaa53a8-27", "ovs_interfaceid": "ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.network.os_vif_util [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:11:2d,bridge_name='br-int',has_traffic_filtering=True,id=ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c,network=Network(c96fda03-0a55-43a3-916e-acf3687e2898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceaa53a8-27') {{(pid=74482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG os_vif [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:11:2d,bridge_name='br-int',has_traffic_filtering=True,id=ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c,network=Network(c96fda03-0a55-43a3-916e-acf3687e2898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceaa53a8-27') {{(pid=74482) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapceaa53a8-27, bridge=br-int, if_exists=True) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49be437e-6fe6-44f8-b123-e0a2f57e2c01) {{(pid=74482) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:25:06 user nova-compute[74482]: INFO os_vif [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:11:2d,bridge_name='br-int',has_traffic_filtering=True,id=ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c,network=Network(c96fda03-0a55-43a3-916e-acf3687e2898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceaa53a8-27')
Oct 24 00:25:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Deleting instance files /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd_del
Oct 24 00:25:06 user nova-compute[74482]: INFO nova.virt.libvirt.driver [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Deletion of /opt/stack/data/nova/instances/4284cf45-9291-4fa4-9264-3aa4f8debafd_del complete
Oct 24 00:25:06 user nova-compute[74482]: INFO nova.compute.manager [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 24 00:25:06 user nova-compute[74482]: DEBUG oslo.service.loopingcall [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74482) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.compute.manager [-] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Deallocating network for instance {{(pid=74482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 24 00:25:06 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] deallocate_for_instance() {{(pid=74482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 24 00:25:07 user nova-compute[74482]: DEBUG nova.network.neutron [-] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Updating instance_info_cache with network_info: [] {{(pid=74482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 24 00:25:07 user nova-compute[74482]: INFO nova.compute.manager [-] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Took 0.75 seconds to deallocate network for instance.
Oct 24 00:25:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:25:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:25:07 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:25:07 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:25:07 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:25:07 user nova-compute[74482]: INFO nova.scheduler.client.report [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Deleted allocations for instance 4284cf45-9291-4fa4-9264-3aa4f8debafd
Oct 24 00:25:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-9ee28cf2-1293-4a46-a652-2de2d0aa2615 tempest-SnapshotDataIntegrityTests-503093126 tempest-SnapshotDataIntegrityTests-503093126-project-member] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.980s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:25:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-d91f7e7a-3d12-4a60-b8e9-18fdd36669fa req-1bdaa7f9-3d1c-4a14-8d1e-225bcf019035 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received event network-vif-plugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:25:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d91f7e7a-3d12-4a60-b8e9-18fdd36669fa req-1bdaa7f9-3d1c-4a14-8d1e-225bcf019035 service nova] Acquiring lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:25:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d91f7e7a-3d12-4a60-b8e9-18fdd36669fa req-1bdaa7f9-3d1c-4a14-8d1e-225bcf019035 service nova] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:25:08 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [req-d91f7e7a-3d12-4a60-b8e9-18fdd36669fa req-1bdaa7f9-3d1c-4a14-8d1e-225bcf019035 service nova] Lock "4284cf45-9291-4fa4-9264-3aa4f8debafd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:25:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-d91f7e7a-3d12-4a60-b8e9-18fdd36669fa req-1bdaa7f9-3d1c-4a14-8d1e-225bcf019035 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] No waiting events found dispatching network-vif-plugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 24 00:25:08 user nova-compute[74482]: WARNING nova.compute.manager [req-d91f7e7a-3d12-4a60-b8e9-18fdd36669fa req-1bdaa7f9-3d1c-4a14-8d1e-225bcf019035 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received unexpected event network-vif-plugged-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c for instance with vm_state deleted and task_state None.
Oct 24 00:25:08 user nova-compute[74482]: DEBUG nova.compute.manager [req-d91f7e7a-3d12-4a60-b8e9-18fdd36669fa req-1bdaa7f9-3d1c-4a14-8d1e-225bcf019035 service nova] [instance: 4284cf45-9291-4fa4-9264-3aa4f8debafd] Received event network-vif-deleted-ceaa53a8-27a7-430b-8e4f-44d86dcdbb2c {{(pid=74482) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 24 00:25:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:21 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:25:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:25:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:25:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:25:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:25:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:25:22 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:25:22 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:25:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:25:26 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:27 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:25:29 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:25:30 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:25:31 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:25:36 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:25:36 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:38 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager.update_available_resource {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:25:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:25:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:25:38 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:25:38 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Auditing locally available compute resources for user (node: user) {{(pid=74482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 24 00:25:39 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:25:39 user nova-compute[74482]: WARNING nova.virt.libvirt.driver [None req-184397cc-1009-497d-9386-18105f2d32bd None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 24 00:25:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=24.848888397216797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 24 00:25:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 24 00:25:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 24 00:25:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 24 00:25:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 24 00:25:39 user nova-compute[74482]: DEBUG nova.compute.provider_tree [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed in ProviderTree for provider: 1a363ec4-e397-463d-b641-d9da25942aa6 {{(pid=74482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 24 00:25:39 user nova-compute[74482]: DEBUG nova.scheduler.client.report [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Inventory has not changed for provider 1a363ec4-e397-463d-b641-d9da25942aa6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 24 00:25:39 user nova-compute[74482]: DEBUG nova.compute.resource_tracker [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Compute_service record updated for user:user {{(pid=74482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 24 00:25:39 user nova-compute[74482]: DEBUG oslo_concurrency.lockutils [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74482) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 24 00:25:41 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:25:46 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:25:51 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:25:56 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:26:00 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:26:01 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:26:03 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:26:06 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:26:11 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 24 00:26:16 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:26:21 user nova-compute[74482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 34 {{(pid=74482) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 24 00:26:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:26:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:26:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Starting heal instance info cache {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 24 00:26:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Rebuilding the list of instances to heal {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 24 00:26:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Didn't find any instances for network info cache update. {{(pid=74482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 24 00:26:24 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 24 00:26:24 user nova-compute[74482]: DEBUG nova.compute.manager [None req-184397cc-1009-497d-9386-18105f2d32bd None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 24 00:26:25 user nova-compute[74482]: DEBUG oslo_service.periodic_task [None req-184397cc-1009-497d-9386-18105f2d32bd None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74482) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}